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METHODS AND DEVICES FOR LOW-FREQUENCY EMPHASIS DURING AUDIO 

COMPRESSION BASED ON ACELP/TCX 

5 FIELD OF THE INVENTION 

The present invention relates to coding and decoding of sound signals 
in, for example, digital transmission and storage systems. In particular but not 
exclusively, the present invention relates to hybrid transform and code-excited 
1 0 linear prediction (CELP) coding and decoding. 

BACKGROUND OF THE INVENTION 

Digital representation of information provides many advantages. In the 
15 case of sound signals, the information such as a speech or music signal is 
digitized using, for example, the' PCM (Pulse Code Modulation) format. The 
signal is thus sampled and quantized with, for example, 16 or 20 bits per 
sample. Although simple, the PCM format requires a high bit rate (number of bits 
per second or bit/s). This limitation is the main motivation for designing efficient 
20 source coding techniques capable of reducing the source bit rate and meet with 
the specific constraints of many applications in terms of audio quality, coding 
delay, and complexity. 

The function of a digital audio coder is to convert a sound signal into a 
25 bit stream which is, for example, transmitted over a communication channel or 
stored in a storage medium. Here lossy source coding, i.e. signal compression, 
is considered. More specifically, the role of a digital audio coder is to represent 
the samples, for example the PCM samples with a smaller number of bits while 
maintaining a good subjective audio quality. A decoder or synthesizer is 
30 responsive to the transmitted or stored bit stream to convert it back to a sound 
signal. Reference is made to [Jayant, 1984] and [Gersho, 1992] for an 
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introduction to signal compression methods, and to the general chapters of 
[Kleijn, 1995] for an in-depth coverage of modem speech and audio coding 
techniques. 

In high-quality audio coding, two classes of algorithms can be 
distinguished: Code-Excited Linear Prediction (CELP) coding which is designed 
to code primarily speech signals, and perceptual transform (or sub-band) coding 
which is well adapted to represent music signals. These techniques can achieve 
a good compromise between subjective quality and bit rate. CELP coding has 
been developed in the context of low-delay bidirectional applications such as 
telephony or conferencing, where the audio signal is typically sampled at, for 
example, 8 or 16 kHz. Perceptual transform coding has been applied mostly to 
wideband high-fidelity music signals sampled at, for example, 32, 44.1 or 48 kHz 
for streaming or storage applications, 

■ 

CELP coding [Atal, 1985] is the core framework of most modern speech 
coding standards. According to this coding model, the speech signal is 
processed in successive blocks of N samples called frames, where N is a 
predetermined number of samples corresponding typically to, for example, 10-30 
ms. The reduction of bit rate is achieved by removing the temporal correlation 
between successive speech samples through linear prediction and using 
efficient vector quantization (VQ). A. linear prediction (LP) filter is computed and 
transmitted every frame. The computation of the LP filter typically requires a 
look-ahead, for example a 5-10 ms speech segment from the subsequent frame. 
In general, the A/-sample frame is divided into smaller blocks called sub-frames, 
so as to apply pitch prediction. The sub-frame length can be set, for example,- in 
the range 4-10 ms. In each sub-frame, an excitation signal is usually obtained 
from two components, a portion of the past excitation and an innovative or fixed- 
codebook excitation. The component formed from a portion of the past excitation 
is often referred to as the adaptive codebook or pitch excitation. The parameters 
characterizing the excitation signal are coded and transmitted to the decoder, 
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where the excitation signal is reconstructed and used as the input of the LP filter. 
An instance of CELP coding is the ACELP (Algebraic CELP) coding model, 
wherein the innovative codebook consists of interleaved signed pulses. 

* 

5 The CELP model has been developed in the context of narrow-band 

speech coding, for which the input bandwidth is 300-3400 Hz. In the case of 
■wideband speech signals defined in the 50-7000 Hz band, the CELP model is 

• usually used in a split-band approach, where a lower band is coded by waveform 
matching (CELP coding) and a higher band is parametrically coded. This 

1 0 ; bandwidth splitting has several motivations: 

- Most of the bits of a frame can be allocated to the lower-band signal to 
maximize quality. 

- The computational complexity (of filtering, etc.) can be reduced compared to 
full-band coding. 

15 . - Also, waveform matching is not very efficient for high-frequency 
components. 

• This split-band approach is used for instance in the ETSI AMR-WB wideband 
f speech coding standard. This coding standard is specified in [3GPP TS 26.190] 

■ 

and described in [Bessette, 2002]. The implementation of the AMR-WB 
20 : standard is given in [3GPP TS 26.173]. The AMR-WB speech coding algorithm 
'■' consists essentially of splitting the input wideband signal into a lower band (0- 
; 6400 Hz) and a higher band (6400-7000 Hz), and applying the ACELP algorithm 
to only the lower band and coding the higher band through bandwidth extension 

• (BWE). 
25 ' 

■ 

The state-of-the-art audio coding techniques, for example MPEG-AAC 
or ITU-T G.722.1, are built upon perceptual transform (or sub-band) coding. In 
•transform coding, the time-domain audio signal is processed by overlapping 
windows of appropriate length. The reduction of bit rate is achieved by the de- 
30 . correlation and energy compaction property of a specific transform, as well as 
coding of only the perceptually relevant transform coefficients. The windowed 
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signal is usually decomposed (analyzed) by a discrete Fourier transform (DFT), 
a discrete cosine transform (DCT) or a modified discrete cosine transform 
(MDCT). A frame length of, for example, 40-60 ms is normally needed to achieve 
good audio quality. However, to represent transients and avoid time spreading of 
5 coding noise before attacks (pre-echo), shorter frames of, for example, 5-10 ms 
are also used to describe non-stationary audio segments. Quantization noise 
shaping is, achieved by normalizing the transform coefficients with scale factors 
prior to quantization. The normalized coefficients are typically coded by scalar 
quantization followed by Huffman coding. In parallel, a perceptual masking curve 
10 is computed to control the quantization process and optimize the subjective 
quality; this curve is used to code the most perceptually relevant transform 
coefficients. 

To improve the coding efficiency (in particular at low bit rates), band 
15 splitting can also be used with transform coding. This approach is used for 
instance in the new High Efficiency MP EG- A AC standard also known as 
aacPlus. In aacPlus, the signal is split into two sub-bands, the lower-band signal 
is coded by perceptual transform coding (AAC), while the higher-band signal is 
described by so-called Spectral Band Replication (SBR) which is a kind of 
20 bandwidth extension (BWE). 

* 

In. certain applications, such as audio/video conferencing, multimedia 
storage and Internet audio streaming, the audio signal consists typically of 
speech, music and mixed content. As a consequence, in such applications, an 

25 audio coding technique which is robust to this type of input signal is used. In 
other words, the audio coding algorithm should achieve a good and consistent 
quality for a wide class of audio signals, including speech and music. 
Nonetheless, the CELP technique is known to be intrinsically speech-optimized 
but may present problems when used to code music signals. State-of-the art 

30 perceptual transform coding on the other hand has good performance for music 
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signals, but is not appropriate for coding speech signals, especially at low bit 
rates. 

■ 

Several approaches have then been considered to code general audio 
5 signals, including both speech and music, with a good and fairly constant quality. 
Transform predictive coding as described in [Moreau, 1992] [Lef ebvre, 1 994] 
[Chen, 1996] and [Chen, 1997], provides a good foundation for the inclusion of 
both speech and music coding techniques into a single framework. This 
approach combines linear prediction and transform coding.. The technique of 
10 [Lefebvre, 1994], called TCX (Transform - Coded eXcitation) coding, which is 
equivalent to those of [Moreau, 1992], [Chen, 1996] and [Chen, 1997] will be 
considered in the following'description. 

Originally, two variants of TCX coding have been designed [Lefebvre, 
15 1994]: one for speech signals using short frames and pitch prediction, another 
for music signals with long frames and no pitch prediction. In both cases, the 
processing involved in TCX coding can be decomposed in two steps: 

1) The current frame of audio signal is processed by temporal filtering to obtain 
20 a so-called target-signal, and then 

♦ 

2) The target signal is coded in transform domain. 

Transform coding of the target signal uses a DFT with rectangular windowing. 
25 Yet, to reduce blocking artifacts at frame boundaries, a windowing with small 
overlap has been used in [Jbira, 1998] before the DFT. In [Ramprashad, 2001], 
a MDCT with windowing switching is used instead; the MDCT has the advantage 

■ 

to provide a better frequency resolution than the DFT while being a- maximally- 
decimated filter-bank. However, in the case of [Ramprashad, 2001], the coder 
30 does not operate in closed-loop, in particular for pitch analysis. In this respect, 
the coder of [Ramprashad, 2001] cannot be qualified as a variant of TCX. 
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The representation of the target signal not only plays a role in TCX 
coding but also controls part of the. TCX audio quality, because it consumes 
most of the available bits in every coding frame. Reference is made here to 

5 transform coding in the DFT domain. Several methods have been proposed to 
code the target signal in this domain, see for instance [Lefebvre, 1994], [Xie, 
1996], [Jbira.1998], [Schnitzler, 1999] and [Bessette, 1999]. All these methods 
implement a form of gain-shape quantization, meaning that the spectrum of the 
target signal is first normalized by a factor or global gain g prior to the' actual 

10 coding. In [Lefebvre, 1994], [Xie, 1996] and [Jbira, 1998], this factor p. is set to 
the RMS (Root Mean Square) value of the spectrum. However, in general, it can 
be optimized in each frame by testing different values for the factor g, as 
.disclosed for example in [Schnitzler, 1999] and [Bessette, 1999]. [Bessette, 
1999] does not disclose actual optimisation of the factor g. To improve the 

15 quality of TCX coding, noise fill-in (i.e. the injection of comfort noise in lieu of 
unquantized coefficients) has been used in [Schnitzler, 1999] and [Bessette, 
1999]. 

As explained in [Lefebvre, 1994], TCX coding can quite successfully code 
20 wideband signals, for example signals sampled at 16 kHz; the audio quality is 
good for speech at a sampling rate of 16 kbit/s and for music at a sampling rate 
of 24 kbit/s. However, TCX coding is not as efficient as ACELP for coding 
speech signals. For that reason, a switched ACELP/TCX coding strategy has 
been presented briefly In [Bessette, 1999]. The concept of ACELP^CX coding is 
25 similar for instance to the ATCELP (Adaptive Transform and CELP) technique of 
[Combescure, 1999]. Obviously, the audio quality can be maximized by 
switching between different modes, which are actually specialized, to code a 
certain type of signal. For instance, CELP coding is specialized for speech and 
transform coding is more adapted to music, so it is natural to combine these two 
30 techniques into a multi-mode framework in which each audio frame is coded 
adaptively with the most appropriate coding tool. In ATCELP coding, the 
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switching between CELP and transform coding is not seamless; it requires 
transition modes. Furthermore, an open-loop mode decision is applied, i.e. the 
mode decision is made prior to coding bas.ed on the available audio signal. On 
the contrary, ACELP/TCX presents the advantage of using two homogeneous 
linear predictive modes (ACELP and TCX. coding), which makes switching 

easier; moreover, the mode decision is closed-loop, meaning that all coding 

■. 

modes are tested and the best synthesis can be selected. 

Although [Bessette, 1999] briefly presents a switched ACELP/TCX coding 
strategy, [Bessette, 1999] does not disclose the ACELP/TCX mode decision and 
details of the quantization of the TCX target signal in ACELP/TCX coding. The 
underlying quantization method is only known to be based on self-scalable mult.k 
rate lattice vector quantization, as introduced by [Xie, 1 996]. 

" Reference is made to [Gibson, 1988] and [Gersho, 1992] for an 
introduction to lattice vector quantization. An A/-dimensional lattice is a regular 
array of points in the A/-dimensional (Euclidean) space. For instance, [Xie, 1996] 
uses an 8-dimensional lattice, known as the^Gosset lattice, which is defined as: 



RE B =2D 9 v{2D § +(1.-*1)) 



(D 



where 



is 



> 



odd] (2) 



and 



D a + = + 1,-,x a + 1)e Z B l(x u -,x B )e D B ) (3) 
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■ 

This mathematical structure enables the quantization of a block of eight 
(8) real numbers. RE 8 can be also defined more intuitively as the set of points 
(x, x 8 ) verifying the properties: 

5 i. The components x, are signed integers (for f=1 ... .,8); 

■ 

■ 

ii. The sum x,-k..+x* is a multiple of 4; and 

iii. The components x, have the same parity (for f=1 8), i.e. they are either 

« 

10 all even, or all odd. 

■ ■ 
■ 

An 8-dimensional quantization codebook can then be obtained by selecting a 
finite subset of RE 8 . Usually the mean-square error, is the codebook search 
criterion, in the technique of [Xie, 1996], six (6) different codebooks, called Q 0 , 

15 Qi, .... Qs. are defined based on the RE 8 lattice. Each codebook Q„ where n=0, 

1 5i comprises 2"" points, which corresponds to ; a rate of An bits per 8- 

dimensional sub-vector or nIZ bits per sample. The spectrum of the TCX target 
signal, normalized by a scaled factor g, is then quantized by splitting it into 8- 
dimensional sub-vectors (or sub-bands). Each of these sub-vectors is coded into 

20 one of the codebooks Q 0 , Qi Q 5 - As a consequence, the quantization of the 

TCX target signal, after normalization by the factor g produces for each 8- 
dimensional sub-vector a codebook number n indicating which codebook Q n has 
been used and an index / identifying a specific codevector in the Codebook Q n . 
This quantization process is referred to as multi-rate lattice vector quantization, 

25 for the codebooks Q„ having different rates. The TCX mode of [Bessette, 1 999] 
follows the same principle, yet no details are provided on the computation of the 
normalization factor g nor on the multiplexing of quantization indices and 
codebooks numbers. 

30 The lattice vector quantization technique of [Xie. 1 996] based on RE 8 has 

been extended in [Ragot, 2002] to improve efficiency and reduce complexity. 
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However, the application of the concept described by [Ragot, 2002] to TCX 
coding has never been proposed. 

In the device of [Ragot, 2002], an 8-dimensional vector is coded through 
5 a multi-rate quantizer incorporating a set of RE S codebooks denoted as {Oo, Q>, 
Ob, .... Qse}. The codebook Q, is not defined in the set in order to improve 
coding efficiency. All codebooks Q„ are constructed as subsets of the same 8- 
dimensional RE 0 lattice, Q„ c RE a . The bit rate of the n lh codebook defined as 
bits per dimension is An/8, i.e. each codebook Q„ contains 2 4n codevectors. The 

1 0 construction of the multi-rate quantizer follows the teaching of [Ragot, 2002]. For 
a given 8-dimensional input vector, the coder of the multi-rate quantizer.finds the 
nearest neighbor in RE a , and outputs a codebook number n and an index / in the 
corresponding codebook Q„. Coding efficiency is improved by applying an 
entropy coding technique for the quantization indices, i.e. codebook numbers n 

1 5 and indices / of the splits. In [Ragot, 2002], a codebook number ri is coded prior 
to multiplexing to the bit stream with an unary code that comprises'a number n-1 
of 1's and a zero stop bit. The codebook number represented by the unary code 
is denoted by n E . No entropy coding is employed for codebook indices /. The 
unary code and bit allocation of n E and /'is exemplified in the following Table 1. 

20 

Table 1 



The number of bits required to index the codebooks; 
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As illustrated in Table 1 , one bit is required for coding the input vector 
when n = 0 and otherwise 5n bits are required. 

» 

5 Furthermore, a practical issue in audio coding is the formatting of the bit 

' 4 

stream and the handling of bad. frames, also known as frame-erasure 
concealment. The bit stream is usually formatted at the coding side as 
successive frames (or blocks) of bits. Due to channel impairments (e.g. CRC 
(Cyclic Redundancy Check) violation, packet loss or delay, etc.), some frames 
10 may not be received correctly at the decoding side. In such a case, the decoder 
typically receives a flag declaring a frame erasure and the bad frame is 
"decoded" by extrapolation based oh the past history of the decoder. A common 
procedure to handle bad frames in CELP decoding consists of reusing the past 
LP synthesis filter, and extrapolating the previous excitation. 

■ 

15 

To improve the robustness against frame losses, parameter repetition, 
also know as Forward Error Correction or FEC coding may be used. 

The problem of frame-erasure concealment for TCX or switched 

* 

20 ACELP/TCX coding has not been addressed yet in the current technology. 

SUMMARY OF THE INVENTION 

* 

In accordance with the present invention, there is provided: 

25 

(1) A method for low-frequency emphasizing the spectrum of a sound signal 
transformed in a frequency domain and comprising transform coefficients 
grouped in a number of blocks, comprising: 

calculating a maximum energy for one block having a position index;. 
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calculating a factor for each block having a position index smaller than 
the position index of the block with maximum energy, the calculation of a factor 
comprising, for each block: 

- computing an energy of the block; and 

- computing the factor from the calculated maximum energy and 
the computed energy of the block; and 

for each block, determining from the factor a gain applied to the 
transform coefficients of the block. 



10 (2) A device for low-frequency emphasizing the spectrum of a sound signal, 
transformed in a frequency domain and comprising transform coefficients 
grouped in a number of blocks, comprising: 

means for calculating a maximum energy for one block having a position 

index; 

15- means for calculating a factor for each block having a position index 

smaller than the position index of the block with maximum energy, the factor 
calculating means comprising, for each block: 

- means for computing an energy of the block; and 

* 

- means for computing the factor from the calculated maximum 
20 energy and the computed energy of the block; and 

means for determining, for each block and from the factor, a gain 
applied to the transform coefficients ofthe block. 

(3) A device for low-frequency emphasizing the spectrum of a sound signal 
25 transformed in a frequency domain and comprising transform coefficients 
grouped in a number of blocks, comprising: 

a calculator of a maximum energy for one block having a position index; 
a calculator of a factor for each block having a position index smaller 
than the position index of the block with maximum energy, wherein the factor 
30 calculator, for each block: 

- computes an energy of the block; and 
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- computes the factor from the calculated maximum energy and 
the computed energy of the block; and 
a calculator of a gain, for each block and in response to the factor, the 
gain being applied to the transform coefficients of the block. 

5 

(4) A method for processing a received, coded sound signal comprising: 

extracting coding parameters from the received, coded sound signal, the 
extracted coding parameters including transform coefficients of a frequency 
transform of said sound signal, wherein the transform coefficients 'were low- 
1 0 frequency emphasized using a method as defined hereinabove; 

processing the extracted coding parameters to synthesize the sound 
signal, processing the extracted coding parameters comprising low-frequency 
de-emphasizing the low-frequency emphasized transform coefficients. 

15 (5) A decoder for processing a received, coded sound signal comprising: 

an input decoder portion supplied with the received, coded sound signal 
and implementing an extractor of coding parameters from the received, coded 
sound signal, the extracted coding parameters including transform coefficients of 
a frequency transform of said sound signal, wherein the transform coefficients 
20 were low-frequency emphasized using a device as defined hereinabove; 

a processor of the extracted coding parameters to synthesize the sound 
signal, said processor comprising a low-frequency de-emphasis module supplied 
with the low-frequency emphasized transform coefficients. 

25 (6) An HF coding method for coding, through a bandwidth extension scheme, an 
HF signal obtained from separation of a full-bandwidth sound signal into the HF 
signal and a LF signal, comprising: 

performing an LPC analysis on the LF and HF signals to produce LPC 
coefficients which model a spectral envelope of the LF and HF signal; 

30 calculating, from the LPC coefficients, an estimation of an HF matching 

difference; 
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calculating the energy of the HF signal; 

processing the LF signal to produce a synthesized version of the HF 

signal; 

calculating the energy of the synthesized version of the HF signal; 
5 calculating a ratio between the calculated energy of the HF signal and 

the calculated energy of the synthesized version of the HF signal, and 
expressing the calculated ratio as an HF compensating gain; and 

calculating a difference between the estimation of the HF matching gain 

* 

and the HF compensating gain to obtain a gain correction; 
10 wherein the coded HF signal comprises the LPC parameters and the 

gain correction. 

* 

(7) An HF coding device for coding, through a bandwidth extension scheme, an 
HF signal obtained from separation of a full-bandwidth sound signal into the HF 
1 5 signal and a LF signal, comprising: 

means for performing an LPC analysis on the LF and HF signals to 
produce LPC coefficients which model a spectral envelope of the LF and HF 
signals; 

means for calculating, from the LPC coefficients, an estimation of an HF 

20 matching gain; 

means for calculating the energy of the HF signal; 

means for processing the LF signal to produce a synthesized version of 

the HF signal; 

means for calculating the energy of the synthesized version of the HF 

25 signal; 

means for calculating a ratio between the calculated energy of the HF 
signal and the calculated energy of the synthesized version of the HF signal, and 
means for expressing the calculated ratio as an HF compensating gain; and 

means for calculating a difference between the estimation of the HF 
30 matching gain and the HF compensating gain to obtain a gain correction; 
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» 

wherein the coded HF signal comprises the LPC parameters and the 
gain correction. 

(8) An HF coding device for coding, through a bandwidth extension scheme, an 
5 HF signal obtained from separation of a full-bandwidth sound signal into the HF 

signal and a LF signal, comprising: 

an LPC analyzing means supplied with the LF and HF signals and 

producing, in response to the HF signal, LPC coefficients which model a spectral 

envelope of the LF and HF signals; 
1 0 a calculator of an estimation of an matching HF gain in response to the 

LPC coefficients; - 

. a calculator of the energy of the HF signal; 

a filter supplied with the LF signal and producing, in response to the LF 
signal, a synthesized version of the HF signal; 
1 5 a calculator of the energy of the synthesized version of the HF signal; 

a calculator of a ratio between the calculated energy of the HF signal 
\ and the calculated energy of the synthesized version of the HF signal; 

a converter supplied with the calculated ratio and expressing said 
calculated ratio as an HF compensating gain; and 
20 a calculator of a difference between the estimation of the HF matching 

gain and the HF compensating gain to obtain a gain correction; 

wherein the coded HF signal comprises the LPC parameters and the 

gain correction. 

25 (9) A method for decoding an HF signal coded through a bandwidth extension 

« 

scheme, comprising: 

receiving the coded HF signal; 

extracting from the coded HF signal LPC coefficients and a gain 
correction; 

30 calculating an estimation of the HF gain from the extracted LPC 

coefficients; 
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adding the gain correction to the calculated estimation of the HF gain to 

obtain an HF gain; 

amplifying a LF excitation signal by the HF gain to produce a HF 

excitation signal; and 

processing the HF excitation signal through a HF synthesis filter to 

produce a synthesized version of the HF signal. 

(10) A decoder for decoding an HF signal coded through a bandwidth extension 

scheme, comprising: 

means for receiving the coded HF signal; 

means for extracting from the coded HF signal LPC coefficients and a 
gain correction; 

means for calculating an estimation of the HF gain from the extracted 
LPC coefficients; 

means for adding the gain correction to the calculated estimation of the 

HF gain to obtain an HF gain; 

means for amplifying a LF excitation signal by the HF gain to produce a 

HF excitation signal; and 

means for processing the HF excitation signal through a HF synthesis 

filter to produce a synthesized version of the HF signal. 

(11) A decoder for decoding an HF signal coded through a bandwidth extension 

scheme, comprising: 

an input for receiving the coded HF signal; 

a decoder supplied with the coded HF signal and extracting from the 
coded HF signal LPC coefficients; 

a decoder supplied with the coded HF signal and extracting from the 

coded HF signal a gain correction; 

a calculator of an estimation of the HF gain from the extracted LPC 

coefficients; 
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an adder of the gain correction and the calculated estimation of the HF 

gain to obtain an HF gain; 

an amplifier of a LF excitation signal by the HF gain to produce a HF 

excitation signal; and 

a HF synthesis filter supplied with the HF excitation signal and producing, 
in response to the HF excitation signal, a synthesized version of the HF signal. 

(1-2) A method of switching from a first sound signal coding mode to a second 
sound signal coding mode at the junction between a previous frame coded 
according to the first coding mode and a current frame coded according to the 
second coding mode, wherein the sound signal is filtered through a weighting 
filter to produce, in the current frame, a weighted signal, comprising: 

calculating a zero-input response of the weighting filter; 

windowing the zero-input response so that said zero-input response has 
an amplitude monotonically decreasing to zero after a predetermined time 

■ 

period; and 

in the current frame, removing from the weighted signal the windowed 
zero-input response. 

(13) A device for switching from a first sound signal coding mode to a second 
sound signal coding mode at the junction between a previous frame coded 
according to the first coding mode and a current frame coded according to the 
second coding mode, wherein the sound signal is filtered through a weighting 
filter to produce, in the current frame, a weighted signal, comprising: 

means for calculating a zero-input response of the weighting filter; 

means for windowing the zero-input response so that said zero-input 
response has an amplitude monotonically decreasing to zero after a 

predetermined time period; and 

means for removing, in the current frame, the windowed zero-input 

response from the weighted signal. 
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(14) A device for switching from a first sound signal coding mode to a second 
sound signal coding mode at the junction between a previous frame coded 
according to the first coding mode and a current frame coded according to the 
second coding mode, wherein the sound signal is filtered through a weighting 
filter to produce, in the current frame, a weighted signal, comprising: 

a calculator of a zero-input response of the weighting filter; 
a window generator for windowing the zero-input response so that said 
zero-input response has an amplitude monotonically decreasing to zero after a 

predetermined time period; and 

an adder for removing, in the current frame, the windowed zero-input 

response from the weighted signal. 

■ 

(15) A method for producing from a decoded target signal an overlap-add target 
signal in a current frame coded according to a first coding mode, comprising: 

windowing the decoded target signal of the current frame in a given 

window; 

skipping a left portion of the window; 

calculating a zero-input response of a weighting filter of the previous 
frame coded according to a second coding mode, and windowing the zero-input 
response so that said zero-input response has an amplitude monotonically 
decreasing to zero after a predetermined time period; and 

adding the calculated zero-input response to the decoded target signal 
to reconstruct said overlap-add target signal. 

(16) A device for producing from a decoded target signal an overlap-add target 
signal in a current frame coded according to a first coding mode, comprising: 

means for windowing the decoded target signal of the current frame in a 

given window; 

means for skipping a left portion of the window; 

means for calculating a zero-input response of a weighting filter of the 
previous frame coded according to a second coding mode, and means for 
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windowing the zero-input response so that said zero-input response has an 
amplitude monotonically decreasing to zero after a predetermined time period; 

and 

means for adding the calculated zero-input response to the decoded 
target signal to reconstruct said overlap-add target signal. 

(17) A device for producing from a decoded target signal an overlap-add target 
signal in a current frame coded according to a first coding mode, comprising: 

a first window generator for windowing the decoded target signal of the 
current frame in a given window; 

means for skipping a left portion of the window; . 

a calculator of a zero-input response of a weighting filter of the previous 
frame coded according to a second coding mode, and a second window 
generator for windowing the zero-input response so that said zero-input 
response has an amplitude monotonically decreasing to zero after a 

predetermined time period; and 

an adder for adding the calculated zero-input response to the decoded 
target signal to reconstruct said overlap-add target signal. 

The foregoing and other objects, advantages and features of the present 
invention will become more apparent upon reading of the following, non 
restrictive description of illustrative embodiments thereof, given by way of 
example only with reference to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
In the appended drawings: 

Figure 1 is a high-level schematic block diagram of one embodiment of 
the coder in accordance with the present invention; 
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Figure 2 is a non-limitative example of timing chart of the frame types in a 
super-frame; 

* 

Figure 3 is a chart showing a non-limitative example of windowing for 
5' . linear predictive analysis, along with interpolation factors as used for 5-ms sub- 
frames and depending on the 20-ms ACELP, 20-ms TCX, 40-ms TCX or'80-ms 
TCX frame mode; ~ 

■ 

Figure 4a-4c are charts illustrating a non-limitative example of frame 
10 windowing in an ACELP/TCX coder, depending on the current frame mode and 
length, and the past frame mode; 

Figure 5a is a high-level block diagram illustrating one embodiment of the 
the structure and method implemented by the coder according to the present 
1 5 invention, for TCX frames; 

• * 

* < 

Figure 5b is a graph illustrating a non-limitative example of amplitude 

' r 

spectrum before and after spectrum pre-shaping performed by the coder of 
Figure 5a; 

20 

Figure 5c is a graph illustrating a non-limitative example of weigthing 
. function determining the gain applied to the spectrum during spectrum pre- 
. shaping; 

4 

■ 

25 ' Figure 6 is a schematic block diagram showing how algebraic coding is 

used to quantize a set of coefficients, for example frequency coefficients on the 
basis of a previously described self-scalable multi-rate lattice vector quantizer 
using a RE 6 lattice; 

30 Figure 7 is a flow chart describing a non-limitative example of iterative 

global gain estimation procedure in log-domain for a TCX coder, this global 
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estimation procedure being a step implemented in TCX coding using a lattice 
quantizer, to reduce the complexity while remaining within the bit budget for a 
given frame; 

5 Figure 8 is a graph illustrating a non-limitative example of global gain 

estimation and noise level estimation (reverse waterf illing) in TCX frames; 

♦ * 

Figure 9 is a flowchart showing an example of handling of the bit budget 
overflow in TCX coding, when calculating the lattice point indices of the splits; 

* 

10 

Figure 10a is a schematic block diagram showing a non-limitative 
example of higher frequency (HF) coder based on bandwidth extension; 

* 

■ • 

Figure 10b are schematic block diagram and graphs showing a non- 
15 limitative example of gain matching procedure performed by the coder of Figure 
10a between lower and higher frequency envelope computed by the coder of 
Figure 10a; 

Figure 1 1 is a high-level block diagram of one embodiment of a decoder 
20 in accordance with the present invention, showing recombination of a lower 
frequency signal coded with hybrid ACELP/TCX, and a HF signal coded using 

* 

bandwidth extension; 

* 

Figure 12 is a schematic block diagram illustrating a non-limitative 
25 example of ACELP/TCX decoder for an LF signal; 

Figure 13 is a flow chart showing a non-limitative example of logic behind 
ACELP/TCX decoding, upon processing four (4) packets forming an 80-ms 
frame; 

30 
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Figure 14 is a schematic block diagram illustrating a non-limitative 
example of ACELP'decoder used in the ACELP/TCX decoder of Figure 12; 

■ 

* 

Figure 15 is a schematic block diagram showing a non-limitative example 
of TCX decoder as used in the ACELP/TCX decoder of Figure 1 2; 

» 

Figure 16 is a schematic block diagram of a non-limitative example of HF 
decoder operating on the basis of the bandwidth extension method; 

Figure 17 is a schematic block diagram of a non-limitative example of 
post-processing and synthesis filterbank at the decoder side; 

Figure 1 8 is a schematic block diagram of a non-limitative example of LF 
coder, showing how ACELP and TCX coders are tried in competition, using a 
segmental SNR (Signal-to-Noise. Ratio) criterion to select the proper coding 
mode for each frame in an 80-ms super-frame; 

Figure 19 is 'a schematic block diagram showing a non-limitative example 
of pre-processing and sub-band decomposition applied at the coder side on 
each 80-ms super-frame; 

* 

• ■ 

Figure 20 is a schematic flow chart describing the operation of the 
spectrum pre-shaping module of the coder of Figure 5a; and 

* 

Figure 21 is a schematic flow chart describing the operation of the 
adaptive low-frequency de-emphasis module of the decoder of Figure. 15. 

■ 

DETAILED DESCRIPTION OF THE ILLUSTRATIVE EMBODIMENTS 
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The non-restrictive illustrative embodiments of the present invention will 
be disclosed in relation to ' an audio coding/decoding device using the 
ACELP/TCX coding model and self-scalable multi-rate lattice vector quantization 
model. However, it should be kept in mind that the present invention could be 
5 equally applied to other types of coding and quantization models. 

• OVERVIEW OF THE CODER 
High-level description of the coder 

A high-level schematic block diagram of one embodiment of a coder 
according to the present invention is illustrated in Figure 1 . 

10 Referring to Figure 1, the input signal is sampled at a frequency of 16 

kHz or higher, and is coded in super-frames such as 1.004 of Tms, for example 
with T= 80 ms. Each super-frame 1.004 is pre-processed and split into two sub- 
bands, for example in a manner similar to pre-processing in AMR-WB. The 
lower-frequency (LF) signals such as 1 .005 are defined within the 0-6400 Hz 

15 band while the higher-frequency (HF) signals such as 1.006 are defined within 
the 6400-F,™ Hz band, where F max is the Nyquist frequency. The Nyquist 
frequency is the minimum sampling frequency which theoretically permits the 
original signal to be reconstituted without distortion: for a signal whose spectrum 
nominally extends from zero frequency to a maximum frequency, the Nyquist 

20 frequency is equal to twice this, maximum frequency. 

Still referring to Figure 1, the LF signal 1.005 is coded through multi- 
mode ACELP/TCX coding (see module 1 .002) built, in the illustrated example, 
upon the AMR-WB core. AMR-WB operates on 20-ms frames within the 80-ms 
super-frame. The ACELP mode is based on the AMR : WB coding algorithm and, 
25 therefore, operates on 20-ms frames. The TCX mode can operate on either 20, 
40 or 80 ms frames within the 80-ms super-frame. In this illustrative example, 
the three (3) TCX frame-lengths of 20, 40, and 80 ms are used with an overlap 
of 2.5, 5, and 10 ms, respectively. The overlap is necessary to reduce the effect 
of framing in the TCX mode (as in transform coding). 
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Figure 2 presents an example of timing chart of the frame types for 
ACELP/TCX coding of the LF signal. As illustrated in Figure 2, the ACELP mode 
can be chosen in any of first 2.001, second 2.002, third 2.003 and fourth 2.004 
20-ms ACELP frames within an 80-ms super-frame 2.005. Similarly, the TCX 
mode can be used in any of first 2.006, second 2.007, third 2.008 and fourth 
2.009 20-ms TC x frames within the 80-ms super-frame 2.005. Additionally, the 
first two or the last two 20-ms frames can be grouped together to form 40-ms 
TCX frames 2.011 and 2.012 to be coded in TCX mode. Finally, the whole 80- 
ms super-frame 2.005 can be coded in one single 80-ms TCX frame 2.010. 
Hence, a total of 26 different combinations of ACELP and TCX frames are 
available to code an 80-ms super-frame such as 2.005. The types of frames, 
ACELP or TCX and their length in an 80-ms super-frame are determined in 
closed-loop, as will be disclosed in the following description. 

Referring back to Figure 1, the HF signal 1.006 is coded using a 
bandwidth extension approach (see HF coding module 1.003). In bandwidth 
extension, an excitation-filter parametric model is used, where the filter is coded 
using few bits and where the excitation is reconstructed at the decoder from the 
received LF signal excitation. Also, in one embodiment, the frame types chosen 
for the lower band (ACELP/TCX) dictate directly the frame length used for 
bandwidth extension in the 80-ms super-frame. 

Super-frame configurations 

All possible super-frame configurations are listed in Table 2 in the form 
(^1, T72, ^73, m 4 ) where -m k denotes the frame type selected for the tf h frame of 
20 ms inside the 80-ms super-frame such that 

m k = 0 for 20-ms ACELP frame, 
m k = 1 for 20-ms TCX frame, 
m k = 2 for 40-ms TCX frame, 
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For example, configuration (1, 0, 2, 2) indicates that the 80-ms super- 
frame is coded by coding the first 20-ms frame as a 20-ms TCX frame (TCX20), 
followed by coding the second 20-ms frame as a 20-ms ACELP frame and finally 
by coding the last two 20-ms frames as a single 40-ms TCX frame (TCX40) 
Similarly, configuration (3, 3, 3, 3) indicates that a 80-ms TCX frame (TCX80) 
defines the whole super-frame 2.005. 



Table 2 

All possible 26 super-frame configurations 



(0, 0, 0, 0) 


(0,0,0,1) 


(2, 2, 0, 0) 




(1,0, 0, 0) 


(1,0, 0, 1) 


(2, 2,1,0) 

• 


♦ 


(0, 1,0,0) 


(0, 1,0, 1) 


(2, 2,0, 1) 


• 
* 


(1,1,0, 0) 


(1.1,0,1) 


(2, 2, 1, 1) 


■ 


(0, 0, 1 . 0) 


(0, 0,1,1) 


(0, 0, 2, 2) 


• 


(1,0,1,0) 


(1,0,1, 1) 


(1,0, 2, 2) 


♦ 


(0, 1,1,0) 


(0, 1,1, 1) 


(0, 1 , 2, 2) 


(2,' 2, 2, 2) 


(1,1,1,0) 


(1,1,1,1) 


(1,1,2, 2) 


(3/ 3, 3, 3) 

* 



Mode selection 

The super-frame configuration can be determined either by open-loop or 
closed-loop decision. The open-loop approach consists of selecting the super- 
frame configuration following some analysis prior to super-frame coding in such 
as way as to reduce the overall complexity. The closed-loop approach consists 
of trying all super-frame combinations and choosing the best one. A closed-loop 
decision generally provides higher quality compared to an open-loop decision, 
with a tradeoff on complexity. A non-limitative example of closed-loop decision is 
summarized in the following Table 3. 



SUBSTITUTE SHEET (RULE 26) 



WO 2005/078706 



25 



PCT/CA2005/000220 



10 



15 



In this non-limitative example of closed-loop decision, all 26 possible 
super-frame configurations of Table 2 can be selected with only 1 1 trials: The left 
half of Table 3 (Trials) shows what coding mode is applied to each 20-ms frame 
at each of the 1 1 trials. Fr1 to Fr4 refer to Frame 1 to Frame 4 in the super- 
frame. Each trial number (1 to 11) indicates a step in the closed-loop decision 
process. The final decision is known only after step 1 1 . It should be noted that 
each 20-ms frame is involved in only four (4) of the 11 trials. When more than 
one (1) frame is involved in a trial (see for example trials 5, 10 and 11), then 
TCX coding of the corresponding length is applied (TCX40 or TCX80). To 
understand the intermediate steps of the closed-loop decision process, the right 
half of Table 3 gives an example of closed-loop decision, where the final 
decision after trial 1 1 is TCX80. This corresponds to a value 3 for the -mode in all 
four (4) 20-ms frames of that particular super-frame. Bold numbers in the 
example at the right of Table 3 show at what point a mode selection takes place 
in the intermediate steps of the closed-loop decision process. 



. Table 3 

Trials and example of closed-loop mode selection 



1 
2 
3 
4 
5 
6 
7 
8 
9 



Fr1 



TRIALS (11) 



Fr 2 Fr 3 



Fr4 



ACELP 








TCX20 










ACELP 








TCX20 






TCX40 


TCX40 










ACELP 








TCX20 










ACELP 








TCX20 



Example of selection 
(in bold = comparison is made) 



Fr1 


Fr2 


: .Fr3 

• 


Fr4 


ACELP 




• 




ACELP 




* 




ACELP 


ACELP 






ACELP 


TCX20 






ACELP 


TCX20 






ACELP 


TCX20 


ACELP 




ACELP 


TCX20 


TCX20 




ACELP 


TCX20 


TCX20 


ACELP 


ACELP 


TCX20 


TCX20 


TCX20 
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10 

11 



• 




TCX40 


TCX40 


TCX80 


TCX80 


TCX80 


TCX80 



ACELP 


TCX20 


TCX40 


TCX40 


TCX80 


TCX80 


TCX80 


TCX80 



The closed-loop decision process of Table 3 proceeds as follows. First, 
in trials 1 and 2, ACELP (AMR-WB) and TCX20 coding are tried on 20-ms frame 
Fr1 . Then, a selection is made for frame Fr1 between these two modes. The 
5 selection criterion can be the segmental Signal-to-Noise Ratio (SNR) between 
the weighted signal and the synthesized weighted signal. Segmental SNR is 
computed using, for example, 5-ms segments, and the coding mode selected is 
the one resulting in the best segmental SNR. In the example of Table 3, it is 
assumed that ACELP mode was retained as indicated in bold on the right side of 
10 Table 3. 

• 

In trial 3 and 4, the same comparison is made for frame Fr2 between 
ACELP and TCX20. In the illustrated example of Table 3, it is assumed that 
TCX20 was better than ACELP. Again TCX20 is selected on the basis of the 
15 above-described segmental SNR measure. This selection is indicated in bold on 
line 4 on the right side of Table 3. 

■ 

In trial 5, frames Fr1 and Fr2 are grouped together to form a 40-ms 
frame which is coded using TCX40. The algorithm now has to choose between 
20 TCX40 for the first two frames Fr1 and Fr2, compared to ACELP in the first 
frame Fr1 and TCX20 in the second frame Fr2. In the example of Table. 3, it is 
assumed that the sequence ACELP-TCX20 was seiected-in accordance with the 
above-described segmental SNR criterion as indicated in bold in line 5 oh the 
right side of Table 3. 

25 

The same procedure as trials 1 to 5 is then applied to the third Fr3 and 
fourth Fr4 frames in trials 6 to 10. Following trial 10 in the example of Table 3, 
the four 20-ms frames are classified as ACELP for frame Fr1 , TCX20 for frame 
Fr2, and TCX40 for frames Fr3 and Fr4 grouped together. 

30 A last trial 1 1 is performed when all four 20-ms frames, i.e. the whole 

80-ms super-frame is coded with TCX80. Again, the segmental SNR criterion is 
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again used with' 5-ms- segments to compare trials 10 and 11. In the example of 
Table 3, it is assumed that the final closed-loop decision is TCX80 for the whole 
super-frame. The mode bits for the four (4) 20-ms frames would then be 
(3,3,3,3) as discussed in Table 2. 

Overview of the TCX mode 

The closed-loop mode selection disclosed above implies that the 
samples in a super-frame have to be coded using ACELP and TCX before 
making the mode decision. ACELP coding is performed as in AMR-WB. TCX 
coding is performed as shown in the block diagram of Figure 5. The TCX coding 
mode is similar for TCX frames of 20. 40 and 80 ms, with a few differences 
mostly involving windowing and filter interpolation. The details of TCX coding will 
be given in the following description of the coder. For now, TCX coding of Figure 
5 can be summarized as follows. 

The input audio signal is filtered through a perceptual weighting filter 
(same perceptual weighting filter : as in AMR-WB) to obtain a weighted signal. 
The weighting filter coefficients are interpolated in a fashion which depends on 
the TCX frame length. If the past frame was an ACELP frame, the zero-input 
response (ZIR) of the perceptual weighting filter is removed from the weighted 
signal. The signal is then windowed (the window shape will be described in the 
following description) and a transform is applied to the windowed signal. In the 
transform domain, the signal is first pre-shaped, to minimize coding noise artifact 
in the lower frequencies, and then quantized using a specific lattice quantizer 
that will be disclosed in the following description. After quantization,-the inverse 
pre-shaping function is applied to the spectrum which is then inverse 
transformed to provide a quantized time-domain signal. After gain reseating, a 
window is again applied to the quantized signal to minimize the block effects of 
quantizing in the transform domain. Overlap-and-add is used with the previous 
frame if this previous frame was also in TCX mode. Finally, the excitation signal 
is found through inverse filtering with proper filter memory updating. This TCX 
excitation is in the same "domain" as the ACELP (AMR-WB) excitation. 
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' Details of TCX coding as shown in Figure 5 will.be described herein • 

below. 

Overview of bandwidth extension (BWE) 

Bandwidth extension is a method used to code the HF signal at low 
5 cost, in terms of both bit rate and complexity. In this non-limitative example, an 
excitation-filter mode! is used to code the HF signal. The excitation is not 
transmitted; rather, the decoder extrapolates the HF signal excitation from the 
received, decoded LF excitation. No bits are required for transmitting the HF 
excitation signal; all the bits related to the HF signal are used to transmit an 

10 approximation of the spectral envelope of this HF signal. A linear LPC model 
(filter) is computed on the down-sampled HF signal 1.006 of Figure i. These 
LPC coefficients can be coded with few bits since the resolution of the ear 
decreases at higher frequencies, and the spectral dynamics of audio signals also 
tends to be smaller at higher frequencies. A gain is also transmitted for every 20- 

15 ms frame. This gain is required to compensate for the lack of matching between 
the HF excitation signal extrapolated from the LF excitation signal and the 
transmitted LPC filter related to the HF signal. The LPC filter is quantized in the 
Immitance Spectral Frequencies (ISF) domain. 

Coding in the lower- and higher-frequency bands is time-synchronous 
20 such that bandwidth extension is segmented over the super-frame according the 
mode selection of the lower band. The bandwidth extension module will be 
disclosed in the following description of the coder. 

Coding Parameters 

The coding parameters can be divided into three (3) categories as 
25 shown in Figure 1 ; super-frame configuration information (or mode information) 
1 .007, LF parameters 1 .008 and HF parameters 1 .009. 

The super-frame configuration can be coded using different approaches. 
For example, to meet specific -system requirements, it is often desired or 
required to send large packets such as 80-ms super-frames, as a sequence of 
30 smaller packets each corresponding to fewer bits and having possibly a shorter 
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duration. Here7each 80-ms super-frame is divided into four consecutive, smaller 
packets. For partitioning a super-frame into four packets, the type of frame 
chosen for each 20-ms frame within a super-frame is indicated by means of two 
bits to be included in the corresponding packet. This can be readily 
accomplished by mapping the integer m k e {0, 1, 2, 3} into its corresponding 
binary representation. It should be recalled that m k is an integer describing the 
coding mode selected for the Jr* 20-ms frame within a 80-ms super-frame. 

« 

The LF parameters depend on the type of frame. In ACE LP frames, the 
LF parameters are the same as those of AMR-WB, in addition to a mean-energy 
parameter to improve the performance of AMR-WB on attacks in music signals. 
More specifically, when a 20-ms frame is coded in ACELP mode (mode 0), the 
LF parameters sent for that particular frame in the corresponding packet are: 

□ The ISF parameters (46 bits reused from AMR-WB); 

a The mean-energy parameter (2 additional bits compared to AMR- 
WB); 

□ The pitch lag (as in AMR-WB); 

□ The pitch filter (as in AMR-WB); 

□ The fixed-codebook indices (reused from AMR-WB); and 

□ The codebook gains (as in 3GPP AMR-WB). 

In TCX frames, the ISF parameters are the same as in the ACELP 
mode (AMR-WB), but they are transmitted only once every TCX frame. For 
example, if the 80-ms super-frame is composed of two 40-ms TCX frames, then 
only two sets of ISF parameters are transmitted for the whole 80-ms super- 
frame. Similarly, when the 80-ms super-frame is coded as only one 80-ms TCX 
frame, then only one set of ISF parameters is transmitted for that super-frame. 
For each TCX frame, either TCX20, TCX40 and TCX80, the following 
parameters are transmitted: 

4 

□ One set of ISF parameters (46 bits reused from AMR-WB); 

a Parameters describing quantized spectrum coefficients in the multi- 
rate lattice VQ (see Figure 6); 
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' □ " ' Noise factor for noise fill-in (3 bits); and - 

□ Global gain (scalar, 7 bits). 

These parameters and their coding will be disclosed in the following 

■ 

description of the coder. It should be noted that a large portion of the bit budget 
5 in TCX frames is dedicated to the lattice VQ indices. 

The HF parameters, which are provided by the Bandwidth extension, 
are typically related to the spectrum envelope and energy. The following HF 
parameters are transmitted : 

□ One set of ISF parameters (order 8, 9 bits) per frame, wherein a 
10 • frame can be a 20-ms ACELP frame, a TCX20 frame, a TCX40 

frame or a TCX80 frame; 

a HF gain (7 bits), quantized as a 4-dimensional gain vectqr, with one 
gain per 20, 40 or 80-ms frame; and 

□ HF gain correction for TCX40 and TCX80 frames, to modify the 

» 

1 5 more coarsely quantized HF gains in these TCX modes. 

Bit allocations according to one embodiment 

The ACELP/TCX codec according to this embodiment can. operate at 
five bit rates: 13.6, 16.8, 19.2, 20.8 and 24.0 kbit/s. These bit rates are related to 

20 some of the AMR-WB rates. The numbers of bits to encode each 80-ms super- 
frame at the five (5) above-mentioned bit rates are 1088, 1344, 1536, 1664, and 
1920 bits, respectively. More specifically, a total of 8 bits are allocated for the 
super-frame configuration (2 bits per 20-ms frame) and 64 bits are allocated for 
bandwidth extension in each 80-ms super-frame. More or fewer bits could be 

25 used for the bandwidth extension, depending on the resolution desired to 
encode the HF gain and spectral envelope. The remaining bit budget, i.e. most 
of the bit budget, is used to encode the LF signal 1.005 of Figure 1. A non- 
limitative example of a typical bit allocation for the different types of frames is 
given in appended Tables 4, 5a, 5b and 5c. The bit allocation for bandwidth 

30 extension is shown in Table 6. These tables indicate the percentage of the total 
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bit budget typically used for encoding the different parameters. It should be 
noted that, in Tables 5b and 5c, corresponding respectively to TCX40 and 
TCX80 frames, the numbers in parentheses show a splitting of the bits into two 
(Table 5b) or four (Table 5c) packets of equal size. For example, Table 5c 
5 indicates that in TCX80 mode, the 46 ISF bits of the super-frame (one LPC filter 
for the entire super-frame) are split into 16 bits in the first packet, 6 bits in the 
second packet, 12 bits in the third packet and finally 12 bits in the last packet. 

Similarly, the algebraic VQ bits (most of the bit budget in TCX modes) 
are split into two packets (Table 5b) or four packets (Table 5c). This splitting is 

10 conducted in such a way that the quantized spectrum is split into two (Table 5b) 
or four (Table 5c) interleaved tracks, where each track contains one out of every 
two (Table 5b) or one out of every four (Table 5c) spectral block. Each spectral 
block is composed of four successive complex spectrum coefficients. This 
interleaving ensures that, if a packet is missing, it will only cause interleaved 

15 "holes" in the decoded spectrum forTCX40 and TCX80 frames. This splitting of 
bits into smaller packets for TCX40 and TCX80 frames has to be done carefully, 

to manage overflow when writing into a given packet. 

* 

DESCRIPTION OF A NON-RESTRICTIVE 
20 ILLUSTRATIVE EMBODIMENT OF THE CODER 

In this embodiment of the coder, the audio signal- is assumed to be 
sampled in the PCM format at 16 kHz or higher, with a resolution of 16 bits per 
sample. The role of the coder is to compute and code parameters based on the 
25 audio signal, and to transmit the encoded parameters into the bit stream for 
decoding and synthesis purposes. A flag indicates to the coder what is the input 
sampling rate. 

A simplified block diagram of this embodiment of the coder is shown in 
30 Figure 1 . 

The input signal is divided into successive blocks of 80 ms, which will be 
referred to as super-frames such as 1.004 (Figure 1) in the following description. 
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Each"80 : m"s~super-frame 1.004 is pre-processed, and then split into two sub- 
band signals, i.e. a LP signal 1.005 and an HF signal 1.006 by a pre-processor 
and analysis filterbank 1.001 using a technique similar to AMR-WB speech 
coding. For example, the LF and HF signals 1.005 and 1.006 are defined in the 
frequency bands 0-6400 Hz and 6400-1 1 025 Hz, respectively. 

■ 

As was disclosed in the coder overview, the LF signal 1 .005 is coded by 
multimode ACELP/TCX coding through a LF (ACELP/TCX) coding module 1 .002 
to produce mode information 1.007 and quantized LF parameters 1.008, while 
the HF signal is coded through an HF (bandwidth extension) coding module 
1 .003 to produce quantized HF parameters 1 .009. As illustrated in Figure 1, the 
coding parameters computed in a given 80-ms super-frame, including the mode 
information 1.007 and the quantized HF and LF parameters 1.008 and 1.009 are 
multiplexed into, for example, four (4) packets 1.011 of equal size through a 
multiplexer 1 .01 0. 

In the following description the main blocks of the diagram of Figure 1 , 
including the pre-processor and analysis filterbank 1.001, the LF (ACELP/TCX) 
coding module 1.002 and the HF coding module 1.003 will be described in more 

* 

detail. 

■ 

Pre-processor and analysis interbank 1.001 

Figure 19 is a schematic block diagram of the pre-processor and 
analysis filterbank 1.001 of Figure 1. Referring to Figure 19, the input 80-ms 
super-frame 1.004 is divided into two sub-band signals, more specifically the LF 
signal 1.005 and the HF signal 1 .006 at the output of pre-processor and analysis 
filterbank 1 .001 of Figure 1 . 

■ 

Still referring to Figure 19, an HF downsampling module 19.001 performs 
downsampling with proper filtering (see for example AMR-WB) of the input 80- 
ms super-frame to obtain the HF signal 1.006 (80-ms frame) and a LF 
downsampling module 19.002 performs downsampling with proper filtering (see 
for example AMR-WB) of the input 80-ms super-frame to obtain the LF signal 
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(80-ms frame), using a method similar to AMR-WB sub-band decomposition. 
The HF signal 1.006 forms the input signal of the HF coding module 1.003 in 
Figure 1. The LF signal from the LF downsampling module 19.002 is further pre- 
processed by two filters before being supplied to the LF coding moduie 1 .002 of 
5 Figure 1. First, the LF signal from module 19.002 is processed through a high- 
pass filter 19.003 having a cut-off frequency of 50 Hz to remove the DC 
-component and the very low frequency components. Then, the filtered LF signal 
from the high-pass filter 19.003 is processed through a de-emphasis filter 19.004 
to accentuate the high-frequency components. This de-emphasis is typical in 
10 wideband speech coders and, accordingly, will not be further discussed in the 
present specification. The output of de-emphasis filter 19.004 constitutes the LF 
signal 1 .005 of Figure 1 supplied to the LF coding module 1 .002. 

* 

LF coding 

» 

♦ 

A simplified block diagram of a non-limitative example of LF coder is 
1 5 shown in Figure 1 8. Figure 1 8 shows that two coding modes, in particular but not 
exclusively ACELP and TCX modes are in competition within every 80-ms 
super-frame. More specifically, a selector switch 18.017 at the output of ACELP 
coder 18.015 and TCX coder 18.016 enables each 20-ms frame within an 80-ms 
super-frame to be coded in either ACELP or TCX mode, i.e. either in TCX20, 
20 TCX40 or TCX80 mode. Mode selection is conducted as explained in the above 
overview of the coder. 

The LF coding therefore uses two coding modes: an ACELP mode 
applied to 20-ms frames and TCX. To optimize the audio quality, the length of 
the frames in the TCX mode is allowed to be variable. As explained 
25 hereinabove, the TCX mode operates either on 20-ms, 40-ms or 80-ms frames. 
The actual timing structure used in the coder is illustrated in Figure 2. 

In Figure 18, LPC analysis is first performed on the input LF signal s(n). 
The window type, position and length for the LPC analysis are shown in Figure 
3, where the windows are positioned' relative to an 80-ms segment of LF signal, 
30 plus a given look-ahead. The windows are positioned every 20 ms. After 
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■ 

* 

windowing, the LPC coefficients are computed every 20 ms, then transformed 
into Immitance Spectral Pairs (ISP) representation and quantized for 
transmission to the decoder. The quantized ISP coefficients are interpolated 
every 5 ms to smooth the evolution of the spectral envelope. 

5 More specifically, module 1 8.002 is responsive to the input LF signal s(n) 

to perform_both windowing and autocorrelation every 20 ms. Module 18.002 is 
followed by module 18.003 that performs lag windowing and white noise 
correction. The lag windowed and white noise corrected signal is processed 
through the Levinson-Durbin algorithm implemented in module 18.004. A module 

10 18.005 then performs ISP conversion of the LPC coefficients. The ISP 
coefficients from module 18.005 are interpolated every 5 ms in the ISP domain 
by module 18.006. Finally, module 18.007 converts the interpolated ISP 
coefficients from module 18.006 into interpolated LPC filter coefficients A(z) 
every 5 ms. 

15 The ISP parameters from module 18.005 are transformed into ISF 

(Immitance Spectral Frequencies) parameters in module 18.008 prior to 
quantization in the ISF domain (module 18.009). The quantized ISF parameters 
from module 1 8.009 are supplied to an ACELP^CX multiplexer 1 8.021 . 

Also, the quantized ISF parameters from module 18.009 are converted 
20 to ISP parameters in module 18.010, the obtained ISP parameters are 
interpolated every 5 ms in the ISP domain by module 18.011, and the 
interpolated ISP parameters are converted to quantized LPC parameters A(z) 
every 5 ms. 

■ 

The LF input signal s(n) of Figure 18 is encoded both in ACELP mode 
25 by means of ACELP coder 18.015 and in TCX mode by means of TCX coder 
18.016 in all possible frame-length combinations as explained in the foregoing 
description. In ACELP mode, only 20-ms frames are considered within a 80-ms 
super-frame, whereas in TCX mode 20-ms, 40-ms and 80-ms frames can be 
considered. All the possible ACELP/TCX coding combinations of Table 2 are 
30 generated by the coders 18.015 and 1 8.016 and then tested by comparing the 
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corresponding synthesized signal to the original signal in the weighted domain. 
As shown in Table 2, the final selection can be a mixture of ACELP and TCX 
frames in a coded 80-ms super-frame. 

For that purpose, the LF signal s(n) is processed through a perceptual 
weighting filter 18.013 to produce a weighted LF signal. In the same manner, the 
synthesized signal from either the ACELP coder 18.015 or the TCX coder 
18.016 depending on the position of the switch selector 18.017 is processed 
through a perceptual weighting filter 18.018 to produce a weighted synthesized 
signal. A subtractor 18.019 subtracts the weighted synthesized signal from the 
weighted LF signal to produce a weighted error signal. A segmental SNR 
computing unit 18.020 is responsive to both the weighted LP signal from filter 
18.013 and the weighted error signal to produce a segmental Signal-to-Noise 
Ratio (SNR). The segmental SNR is produced every 5-ms sub-frames. 
Computation of segmental SNR is well known to those of ordinary skill in the art 
and, accordingly, will not be further described in the present specification. The 
combination of ACELP and/or TCX modes which minimizes the segmental SNR 
over the 80-ms super-frame is chosen as the best coding mode combination. 
Again, reference is made to Table 2 defining the 26 possible combinations of 
ACELP and/or TCX modes in a 80-ms super-frame. 

ACELP mode 

The ACELP mode used is very similar to the ACELP algorithm operating 
at 12.8 kHz in the AMR-WB speech coding standard. The main changes 
compared to the ACELP algorithm in AMR-WB are: 

o The LP analysis uses a different windowing, which is illustrated in Figure 
3. 

q Quantization of the codebook. gains is done every 5-ms sub-frame, as 
explained in the following description. 

The ACELP mode operates on 5-ms sub-frames, where pitch analysis and 
algebraic codebook search are performed every sub-frame. 
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Codebook gain quantization in ACELP mode 

* 

■ In a given 5-ms ACELP sub-frame the two codebook gains, including 
the pitch gain g p and fixed-codebook gain g c are quantized jointly based on the 
7-bit gain quantization of AMR-WB. However, the Moving Average (MA) 
prediction of the fixed-codebook gain g e , which is used in AMR-WB, is replaced 
by an absolute reference which is coded explicitly. Thus, the codebook gains are 
quantized by a form of mean-removed quantization. This memoryless (non- 
predictive) quantization is well justified, because the ACELP mode may be 
applied: to non-speech signals, for example transients in a music signal, which 
requires a more general quantization than the predictive approach of AMR-WB. 

Computation and quantization of the absolute reference (in log domain) 

A parameter, denoted /w is computed in open-loop and quantized 
once per frame with 2 bits. The current 20-ms frame of LPC residual r = (r 0 , r, , 
;.. , r L ) where L is the number of samples in the frame, is divided into four (4) 5- 

ms sub-frames, r F W0), .... r{L^)), with i = 0, 1 3 and L sub is the number 

of sample in the sub-frame. The parameter /w is simply defined as the 
average of energies of the sub-frames (in dB) over the current frame of the 
LPC residual: 

/jm eo(dB)+ ei(dB)+e2(dB)+ez(dB) 
/w(dB)= 7 



where 



r,(0) 2 + ... + n(L™<r-l) 2 
e/=H j — 

L/sub 



is the energy of the Mh sub-frame of the LPC residual and a(<ffi)=101ogio{a}. A 
constant 1 is added to the actual sub-frame energy in the above equation to 
avoid the subsequent computation of the logarithmic value of 0. 



SUBSTITUTE SHEET (RULE 26) 



WO 2005/078706 



37 



PCT/CA2005/000220 



A mean value of parameter /w is then updated as follows: 

Mener (dB) := Merer (dB) - 5 * (Pi + P2) 

where p, (i = 1 or 2) is the normalized correlation computed as a side product of 
5 the Mh open-loop pitch analysis. This modification of /w improves the audio 
quality for voiced speech segments. 

The mean /w (dB) is then scalar quantized with 2 bits. The 
quantization levels are set with a step of 12 dB to 18, 30, 42 and 54 dB. The 
quantization index can be simply computed as : 

10 'tmp = ( /Wr -1 8 ) / 1 2 

index = floor(tmp+0.5) 
if. (index < 0) index =0, if (index > 3) index =3 
Here, floor means taking the integer part of the a floating-point number. For 
example floor(1 .2) = 1 , and f loor(7.9) = 7. 



15 



The reconstructed.mean (in dB) is therefore: 



^en*r(dB)=18+(index*12). 

• * 

However, the index and the reconstructed mean are then updated to improve 
20 the audio quality for transient signals such as attacks as follows: 

max = max (e, (dB), e 2 (dB), e 3 (dB), e 4 (dB)) 
• if Ji Bner (dB) < (max-27) and index < 3, 
index = index +1 and M <™r (dB) = m ener (dB) +1 
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Quantization of the codebook gains 

m 

« 

In AMR-WB, the pitch and fixed-codebook gains g p and g c are quantized 
jointly in the form of (g p . g c ' go) where g* combines a MA prediction for g c and 
a normalization with respect to the energy of the innovative codevector. 

The two gains g p and g c in a given sub-frame are jointly quantized with 7 
bits exactly as in AMR-WB speech coding, in the form of (g p , g G *g c o)- The only 
difference lies in the computation of gc, The value of go is based on the 
quantized mean energy m e„ 9 ,only, and computed as follows: 

9c0 = 1 o*((m ener (dB) ■ ener c (dB) ) /20) 

■ 

where 

ener c (dB) = 10 *log10(0.01 + (c(0)'2+...+c(L sub -1)'2)/L S ub) 

where c(0) c(L sub -1) are samples of the LP residual vector in a subframe of 

length L sub samples. c(0) is the first sample, c(1) is the second sample and 

c(L sub ) is the last LP residual sample in a subframe. 

TCX mode 

In the TCX modes' (TCX coder 18.016), an overlap with the next frame 
is defined to reduce blocking artifacts due to transform coding of the TCX target 
signal. The windowing and signal overlap depends both on the present frame 
type (ACELP or TCX) and size, and on the past frame type and size. Windowing 
will be disclosed in the next section. 

One embodiment of the TCX coder 18.016 is illustrated in Figure 5a. 
The TCX encoding procedure will now be described and, then, description about 
the lattice quantization used to quantize the spectrum will follow. 

TCX encoding according to one embodiment proceeds as follows. 
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First, as illustrated in Figure 5a, the input signal (TCX frame) is filtered 
through a perceptual weighting filter 5.001 to produce a weighted signal. In TCX 
modes, the perceptual weighting filter 5.001 uses the quantized LPC coefficients 
A(z) instead of the unquantized LPC coefficients A(z) used in ACELP mode. This 
5 is because, contrary to ACELP which uses analysis-by-synthesis, the TCX 
decoder has to apply an inverse weighting filter to recover the excitation signal. If 
the previous coded frame was an ACELP frame, then the zero-input response 
(ZIR) of the perceptual weighting filter is removed from the weighted signal by 
means of an adder 5.014. In one embodiment, the ZIR is truncated to 10 ms and 

10 windowed in such a way that its amplitude monotonically decreases to zero after 
10 ms (calculator 5.100). Several time-domain windows can be used for this 
operation. The actual computation of the ZIR is not shown in Figure 5a since this 
signal, also referred to as the "filter ringing" in CELP-type coders, is well known 
to those of ordinary skill in the art. Once the weighted signal is computed, the 

15 signal is windowed in adaptive window generator 5.003, according to a window 
selection described in Figures 4a-4c. 

After windowing by the generator 5.003, a transform module 5.004 
transforms the windowed signal into the, frequency-domain using a Fast Fourier 
Transform (FFT). 

20 Windowing in the. TCX modes - 'Adaptive windowing module 5. 003 

Mode switching between ACELP frames and TCX frames will now be 
described. To minimize transition artifacts upon switching from one mode to the 
other, proper care has to be given to windowing and overlap of successive 

* 

frames. Adaptive windowing is performed by Processor 6.003. Figures 4a-4c 
25 show the window shapes depending on the TCX frame length and the type of 
the previous frame (ACELP of TCX). 

In Figure 4a, the case where the present frame is a TCX20 frame is 
considered. Depending on the past frame, the window applied can be : 

1) If the previous frame was a 20-ms ACELP, the window is a concatenation 
30 of two window segments: a flat window of 20-ms duration followed by the 
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half-right portion of the square-root of a Harming window (or the half-right 
portion of a sine window) of 2.5-ms duration. The coder then needs a 
lookahead of 2.5 ms of the weighted speech. . 

2) If the previous frame was a TCX20 frame, the window is a concatenation of 
three window segments: first, the left-half of the square-root of a Hanning 
window (or the left-half portion of a sine window) of 2.5-ms duration, then a 
flat window of 17.5-ms duration, and finally, the half-right portion of the 
square-root of a Hanning window (or the half-right portion of a sine 
window) of 2.5-ms duration. The coder again needs a lookahead of 2.5 ms 
of the weighted speech. 

. ■ 

3) If the previous frame was a TCX40 frame, the window is a concatenation of 
three window segments: first, the left-half of the square-root of a Hanning 
window (or the left-half portion of a sine window) of 5-ms duration, then a 

■ flat window of 15-ms duration, and finally the half-right portion of the 
square-root of a Hanning window (or the half-right portion of a sine 
window) of 2.5-ms duration. The coder again needs a lookahead of 2.5 ms 
of the weighted speech. 

4) If the previous frame was a TCX80 frame, the window is a concatenation of 
three window segments: first, the left-half of the square-root of a Hanning 
window (or the left-half portion of a sine window) of 10 ms duration, then a 
flat window of 10-ms duration, and finally the half-right portion of the 
square-root of a Hanning window (or the • half-right portion of a sine 
window) of 2.5-ms duration." The coder again needs a lookahead of 2.5 ms 
of the weighted speech. 

In Figure 4b, the case where the present frame is a TCX40 frame is 
considered. Depending on the past frame, the window applied can be : 

■ 

1) If the previous frame was a 20-ms ACEllP frame, the window is a 
concatenation of two window segments: a flat window of 40-ms duration 
followed by the half-right portion of the square-root of a Hanning window 
(or the half-right portion of a sine window) of 5-ms duration. The coder then 
needs a lookahead of 5 ms of the weighted speech. 
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2) If the previous frame was a TCX20 frame, the window is a concatenation of 
three window segments: first, the left-half of the square-root of a Hanning 
window (or the left-half portion of a sine window) of 2.5-ms duration, then a 
flat window of 37.5-ms duration, and finally the half-right portion of the 
square-root of a Hanning window (or the half-right portion of a sine 
window) of 5-ms duration. The coder again needs a lookahead of 5 ms of 
the weighted speech. 

3) If the previous frame was a TCX40 frame, the window is a concatenation of 
three window segments: first, the left-half of the square-root of a Hanning 
window (or the left-half portion of a sine window) of 5-ms duration, then a 
flat window of 35-ms duration, and finally the half-right portion of the 
square-root of a Hanning window (or the half-right portion of a sine 
window) of 5-ms duration. The coder again needs a lookahead of 5 ms of 
the weighted speech. 

4) If the previous frame was a TCX80 frame, the window is a concatenation of 
three window segments: first, the left-half of the square-root of the square- 
root of a Hanning window (or the left-half portion of a sine window) of 10- 
ms duration, then a flat window of 30-ms duration, and finally the half-right 
portion of the square-root of a Hanning window (or the half-right portion of 
a sine window) of 5-ms duration. The coder again needs a lookahead of 5 
ms of the weighted speech. 

Finally, in Figure 4c, the case where the present frame is a TCX80 
frame is considered. Depending on the past frame, the window applied can be : 

1) If the previous frame was a 20-ms ACELP frame, the window is a 
concatenation of two window segments: a flat window of 80-ms duration 
followed by the half-right portion of the square-root of a Hanning window 
(or the half-right portion of a sine window) of 5-ms duration. The coder then 
needs a lookahead of 10 ms of the weighted speech. 

2) If the previous frame was a TCX20 frame, the window is a concatenation of 
three window segments: first, the left-half of the square-root of a Hanning 
window (or the left-half portion of a sine window) of 2.5-ms duration, then a 
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fiat window of 77.5-ms duration, and finally the half-right portion of the 
square-root of a Hanning window (or the half-right portion of a sine 
window) of 10-ms duration. The coder again needs a lookahead of. 10 ms 
of the weighted speech. 

5 3) If the previous frame was a TCX40 frame, the window is a concatenation of 
three window segments: first, the left-half of the square-root of a Hanning 
window (or the left-half portion of a sine window) of 5-ms duration, then a 
flat window of 75-ms duration, and finally the half-right portion of the 
square-root of a Hanning window (or the half-right portion of a sine 
10 window) of 10-ms duration. The coder again needs a lookahead of 10 ms 

of the weighted speech. 

4) If the previous frame was a TCX80 frame, the window is a concatenation of 
three window segments: first, the left-half of the square-root of a Hanning 
window (or the left-half portion of a sine window) of 10-ms duration, then a 
15 flat window of 70-ms duration, and finally the half-right portion of the 

square-root of a Hanning window (or the half-right portion of a sine 
window) of 10-ms duration. The coder again needs a lookahead of 10 ms 
of the weighted speech. s 

It is noted that all these window types are applied to the weighted signal, 
20 only when the present frame is a TCX frame. Frames of ACELP type are 
encoded substantially in accordance with AMR-WB coding, i.e. through analysis- 
by-synthesis coding of the excitation signal, so as to minimize the error in the 
target signal wherein the target signal is essentially the weighted signal to which 
the zero-input response of the weighting filter is removed. It is also noted that, 

* 

25 upon coding a TCX frame that is preceded by another TCX frame, the signal 
windowed by means of the above-described windows is quantized directly in a 
transform domain, as will be disclosed herein below. Then after quantization and 
inverse transformation, the synthesized weighted signal is recombined using 
overlap-and-add at the beginningof the frame with memorized look-ahead of the 

30 preceding frame. 
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On the other hand, when encoding a TCX frame preceded by an ACELP 
frame, the zero-input response of the weighting. filter, actually a windowed and 
truncated version of the zero-input response, is first removed from the windowed 
weighted signal. Since the zero-input response is a good approximation of the 
5 first samples of the frame, the resulting effect is that the windowed signal will 
tend towards zero both at the beginning of the frame (because of the zero-input 
response subtraction) and at the end of the frame (because of the half-Hanning 
window applied to the look-ahead as described above and shown in Figures 4a- 
4c). Of course, the windowed and truncated zero-input response is added back 
1 0 to the quantized weighted signal after inverse transformation. 

Hence, a suitable compromise is achieved between an optimal window 
(e.g. Hanning window) prior to the transform used in TCX frames, and the 
implicit rectangular window that has to be applied to the target signal when 
encoding in ACELP mode. This ensures a smooth switching between ACELP 
15 and TCX frames, while allowing proper windowing in both modes. 

« 

Time-frequency mapping - Transform Module 5.004 

After windowing as described above, a transform is applied to the 
weighted signal in transform module 5.004. In the example of Figures 5a, a Fast 
Fourier Transform (FFT) is used. 

20 As illustrated in Figures 4a~4c, TCX mode uses overlap between 

successive frames to reduce blocking artifacts. The length of^ the overlap 
depends on the length of the TCX modes: it is set respectively to 2.5, 5 and 10 
ms when the TCX mode works with a frame length of 20, 40 and 80 ms, 
respectively (i.e. the length of the overlap is set to 1/8 th of the frame length). This 

25 choice of overlap simplifies the radix in the fast computation of the DFT by the 
FFT. As a consequence the effective time support of the TCX20, TCX40 and 
TCX80 modes is 22.5, 45 and 90 ms, respectively, as shown in Figure 2. With a 
sampling frequency of 12,800 samples per second (in the LF signal produced by _ 
pre-processor and analysis filterbank 1.001 of Figure 1), and with 

30 frame+lookahead durations of 22.5, 45 and 90 ms, the time support of the FFT 
becomes 288, 576 and 1152 samples, respectively. These lengths can be 
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expressed as 9 times 32, 9 times 64 and 9 times 128. Hence, a specialized 
radix-9 FFT can then be used to compute rapidly the Fourier spectrum. 

Pre-shaping (low-frequency emphasis) - Pre-shaping module 5.005. 

Once the Fourier spectrum (FFT) is computed, an adaptive low- 
5 frequency emphasis is applied to the signal spectrum by the spectrum pre- 
shaping module 5.005 to minimize the perceived distortion in the lower 
frequencies. An inverse low-frequency emphasis will be applied at the decoder, 
as well as in the coder through a spectrum de-shaping module 5.007 to produce 
the excitation signal used to encode the next frames. The adaptive low- 
10 frequency emphasis is applied only to the first quarter of the spectrum, as 
follows. 

First, let's call X the transformed signal at the output of the FFT 
transform module 5.004. The Fourier coefficient at the Nyquist frequency is 

1 5 systematically set to 0. Then, if N is the number of samples in the FFT (N thus 
corresponding to the length of the window), the K=N/2 complex-value Fourier 
coefficients are grouped in blocks of four (4) consecutive coefficients,' forming 8- 
dimensional real-value blocks. Just a word to mention that block lengths of size 
different from 8 can be used in general. In one embodiment, a block size of 8 is 

20 chosen to coincide with the 8-dimenslonal lattice quantizer used for spectral 
quantization. Referring to Figure 20, the energy of each block is computed, up to 
the first quarter of the spectrum, and the energy E mM and the position index / of 
the block with maximum energy are stored (calculator 20.001). Then a factor R m 
is calculated for each 8-dimensional block with position index m smaller than / 

25 (calculator 20.002)as follows : 

□ calculate the energy E m of the 8-dimensional block at position 
index m (module 20.003); 

a compute the ratio R m = Em« / E m (module 20.004); 

□ if R m > 1 0, then set R m = 1 0 (module 20.005); 
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□ alSO, if R m > H(m-1) then R m = FUu (module 20.006); 

a compute the value (R m ) 1/4 (module 20.007). 

The last condition (if R m > /Vu then R <» = *W ensures that the ratio 
function R m decreases monotonically. Further, limiting the ratio R m to be smaller 
or equal to 10 means that no spectral components in the low-frequency 
emphasis function will be modified by more than 20 dB. 

After computing the ratio (Rj /4 = (5™* / Em) 1/4 for all blocks with 
position index smaller that / (and with the limiting conditions described above), 
these ratios are applied as a gain for the transform coefficients each 
corresponding block (calculator 20.008). This has the effect of increasing the 
energy of the blocks with a relatively low energy compared to the block with 
maximum energy E max . Applying this procedure prior to quantization has the 
effect of shaping the coding noise in the lower band. 

« 

Figure 5b shows an example spectrum on which the above disclosed 
pre-shaping is applied. The frequency axis is normalized between 0 and 1 , 
where 1 is the Nyquist frequency. The amplitude spectrum is shown in dB. In 
Figure 5b, the bold line is the amplitude spectrum before pre-shaping, and the 
non-bold line portion is the modified (pre-shaped) spectrum. Hence, only the 
spectrum corresponding to the non-bold line is modified in this example. In 
Figure 5c, the actual gain applied to each spectral component by the pre- 
shaping function is shown. It can be seen from Figure 5c that the gain is limited 
to 10, and monotonically decreases to 1 as it reaches the spectral component 
with highest energy (here, the third harmonic of the spectrum) at the normalized 
frequency of about 0.18. 

« 

Split multi-rate lattice vector quantization - Module 5.006 

After low-frequency emphasis, the spectral coefficients are quantized 
using, in one embodiment, an algebraic quantization module 5.006 based on 
lattice codes. The lattices used are 8-dimensional Gosset lattices, which 
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explains the splitting of the spectral coefficients in 8-dimensional blocks. The 
quantization indices are essentially a global gain and a series of indices 
describing the actual lattice points used to quantize each 8-dimensional sub- 
vector in the spectrum. The lattice quantization module 5.006 performs, in a 
structured manner, a nearest neighbor search between each 8-dimensional 
vector of the scaled pre-shaped spectrum from module 5.005 and the points in a 
lattice codebook used for quantization. The scale factor (global gain) actually 
determines the bit allocation and the average distortion. The larger the global 
gain, the more bits are used and the lower the average distortion. For each 8- 
dimensional vector of spectral coefficients, the lattice quantization module 5.006 
outputs an index which indicates the lattice codebook number used and the 
actual lattice point chosen in the corresponding lattice codebook. The decoder 
will then be able to reconstruct the quantized spectrum using the global gain 
index along with the indices describing each 8-dimensional vector. The details of 
this procedure will be disclosed below. 

Once the spectrum is quantized, the global gain from the output of the 
gain computing and quantization module 5.009 and the lattice vectors indices 
from the output of quantization module 5.006) can be transmitted to the decoder 
through a multiplexer (not shown). 

* 

Optimization of the global gain and computation of the noise-fill factor 

■ A non-trivial step in using lattice vector quantizers is to determine the 
proper bit allocation within a predetermined bit budget. Contrary to stored 
codebooks, where the index of a codebook is basically its position in a table, the 
index of a lattice codebook is calculated using mathematical (algebraic) 
formulae. The number of bits to encode the lattice vector index is thus only 
known after the input vector is quantized. In principle, to stay within a pre- 
determined bit budget, trying several global gains and quantizing the normalized 
spectrum with each different gain to compute the total number of bits are 
performed. The global gain which achieves the bit allocation closest to the pre- 
determined bit budget, without exceeding it, would be chosen as the optimal 
gain. In one embodiment, a heuristic approach is used instead, to avoid having 
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to quantize the spectrum several times before obtaining the optimum 
quantization and bit allocation. 

For the sake of clarity, the key symbols related to the following 
description are gathered from Table A-1. 

9 

■ 

* 

. Referring from Figure 5a, the time-domain TCX weighted signal x is 
processed by a transform T and a pre-shaping P, which produces a spectrum X 
to be quantized. Transform T can be a FFT and the pre-shaping may 
correspond to the above-described adaptive low-frequency emphasis. ■ ■ 

Reference will be_made to vector X as the pre-shaped spectrum. It is 
assumed that this vector has the form X = [X 0 X, ... X»,}\ where N is the 
number of transform coefficients obtained from transform T (the pre-shaping P 
does not change this number of coefficients). 

Overview of the quantization procedure for the pre-shaped spectrum 

In one embodiment, the pre-shaped spectrum X is quantized as 
described in Figure 6. The quantization is based on the device of [Ragot, 2002], 
assuming an available bit budget of R x bits for encoding X. As shown in Figure 
6, X is quantized by gain-shape split vector quantization in three main steps: 

o An estimated global gain g, called hereafter the global gain, is computed 
by a split energy estimation module 6.001 and a global gain and noise 
level estimation module 6.002, and a divider 6.003 normalizes the 
spectrum X by this global gain g to obtain X'= X/g, where X' is the 
normalized pre-shaped spectrum. 

o The multi-rate lattice vector quantization of [Ragot, 2002] is applied by a 
split self-scalable multirate RE 8 coding module 6.004 to all 8-dimensional 
blocks of coefficients forming the spectrum X', and the resulting 
parameters are multiplexed. To be able to apply this quantization 
scheme, the spectrum X' is divided into K sub-vectors of identical size, 
so that X = [X'o T X', T ... X'/mY. where the I? sub-vector (or split) is 
given by 
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Since the device of [Ragot, 2002] actually implements a form of 8- 
dimensional vector quantization, K is simply set to 8. It is assumed that N 
is a multiple of K. 

5 o A noise fill-in gain fac is computed in module 6.002 to later inject comfort 
noise in unquantized splits of the spectrum X'. The unquantized splits are 
blocks of coefficients which have been set to zero by the quantizer. The 
injection of noise allows to mask artifacts at low bit rates and improves 
audio quality. A single gain fac is used because TCX coding assumes 
10 that the coding noise is flat in the target domain and shaped by the 

inverse perceptual filter W(z)' 1 , Although pre-shaping is used here, the 
quantization and noise injection relies on the same principle. 

As a consequence, the quantization of the spectrum X shown in Figure 
6 produces three kinds of parameters: the global gain g, the (split) algebraic VQ 
15 parameters and the noise fill-in gain* fac. The bit allocation, or bit budget R x is 
decomposed as: 

where R g , R and R fac are the number of bits (or bit budget) allocated to the gain 
g, the algebraic VQ parameters, and the gain fac, respectively. In this illustrative 

* 

20 embodiment, R fac = 0. 

The multi-rate lattice vector quantization of [Ragot, 2002] is self -scalable 
and does not allow to control directly the bit allocation and the distortion in each 
split. This is the reason why the device of [Ragot, 2002] is applied to the splits of 
the spectrum X 1 instead of X. Optimization of the global gain g therefore controls 
25 the quality of the TCX mode. In one embodiment, the optimization of the gain g 
is based on log-energy of the splits. 

In the following description, each block of Figure 6 is described one by 

one. 
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Split energy estimation module 6. 00 1 

* 

The energy (i.e. square-norm) of the split vectors is used in the bit 
allocation algorithm, and is employed for determining the global gain as well as 
the noise level. Just a word to recall that the AZ-dimensional input vector X = 
• 5 [xo, x, ... x N -i] T is partitioned into K splits, 8-dimensional subvectors, such that 
_ the /c" 1 split becomes x k = [x ak x 8 **.i ...xe**7] T for fc= 0, 1, .... K-1. It is assumed 
that N is a multiple of eight. The energy of the split vector is computed as 

e k = x k x k = x&k + — + Xe/c+7 2 , K=0, 1, ... K-1 



1 o Global gain and noise level estimation module 6. 002 

The global gain g controls directly the bit consumption of the splits and 
is solved from R(g) - R, where R(g) is the number of bits used (or bit 
consumption) by all the split algebraic VQ for a given value of g. As indicated in 
the foregoing description, R is the bit budget allocated to the split algebraic VQ. 
15 As a consequence, the global gain g is optimized so as to match the bit 
consumption and the bit budget of algebraic VQ. The underlying principle is 
known as reverse water-filling in the literature. 

To reduce the quantization complexity, the actual bit consumption for 
each split is not computed, but only estimated from the energy of the splits. This 
20 energy information together with an a priori knowledge of multi-rate RE 8 vector 
quantization allows to estimate R(g) as a simple function of g. 

The global gain g is determined by applying this basic principle in the 
global gains and noise level estimation module 6.002. The bit consumption 
estimate of the split X* is a function of the global gain g, and is denoted as Rkig). 
■ 25 With unity gain g = 1 heuristics give: 

fl/c(1) = 5 iog 2 (5+ e k )/2, km 0, 1 K-1 
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as a bit consumption estimate. The constant e > 0 prevents the computation of 
log 2 0 and, for example, the value e = 2 is used. In general the constant e is 
negligible compared to the energy of the split e*. 

The formula of f?*(1) is based on a priori knowledge of the multi-rate 
quantizer of [Ragot, 2002] and the properties of the underlying flE„ lattice: 

o For the codebook number n k > 1, the bit budget requirement for coding 
the /<* split at most 5n k bits as can be confirmed from Table 1. This gives 
a factor 5 in the formula when log 2 (e+ e*)/2 is as an estimate of the 
codebook number. 

o The logarithm log 2 reflects the property that the average square-norm of 
the codevectors is approximately doubled when using Q nk instead of 
Qn„ +1 . The property can be observed from Table 4. 

o The factor 1/2 applied to e + e k calibrates the codebook number estimate 
for the codebook Q 2 . The average square-norm of lattice points in this 
particular codebook is known to be around 8.0 (see Table 4). Since log 2 
(e + e2))/2 = log 2 (2 + 8.0))/2 = 2, the codebook number estimation is 
indeed correct for Q 2 . 



table 4 

Some statistics on the square norms 
of the lattice points in different codebooks. 
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0 
2 




CO 


&^2b|09^ 


4 




5 


"93.85%*' 


6 


-182.49 ^ 


7 


:;. 362.74' 



SUBSTITUTE SHEET (RULE 26) 



WO 2005/078706 PCT/CA2005/000220 

51 



When a global gain g is applied to a split, the energy of xjg is obtained 
by dividing e k by g 2 . This implies that bit consumption of the gain-scaled split can 
be estimated based on by subtracting 5 iog 2 g 2 = 10 log 2 oTrom it: 

Rk{9) = 5log 2 (e+e k )/2g* 

= 5 log 2 (e + e*)/2 + 5 log 2 g 2 

= ) - flioB W 

in which gi og = 10 log 2 g. The estimate R k (g) is lower bounded to zero, thus the 
relation 



R k {g) = max{R A (1)-gio g . 0} (5) 



1 0 is used in practice. 



The bit consumption for coding all K splits is now simply a sum over the 
individual splits, 

Fi{g) - flote) +' fli(g) + - + fl/M(3). ( 6 ) 

The nonlinearity of equation (6) prevents solving analytically the global gain g 
1 5 that yields the bit consumption matching the given bit budget, R(g) = R 
However, the solution can be found with a simple iterative algorithm because 
R(g) is a monotonous function of g. 

In one embodiment, the global gain g is searched efficiently by applying a 
bisection search to gbg = 10 log 2 g, starting from the value ^ = 128. At each 
20 iteration iter, R{g) is evaluated using equations (4), (5) and (6), and g\ og is 
respectively adjusted as gi og = giog ± 128/2 ,ter . Ten iterations give a sufficient 
accuracy. The global gain can then be solved from a og as g = 2 9v " . 

The flow chart of Figure 7 describes the bisection algorithm employed for 
determining the global gain g. The algorithm provides also the noise level as a 
25 side product. The algorithm starts by adjusting the bit budget Ft in operation 
7.001 to the value 0.95(fl-K). This adjustment has been determined 

■ 

experimentally in order to avoid an over-estimation of the optima! global gain g. 
The bisection algorithm requires as its initial value the bit consumption estimates 
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for k = 0, 1 K- 1 assuming a unity global gain. These estimates are 

computed employing equation (4) in operation 7.002 having first obtained the 
square-norms of the splits e k . The algorithm starts from the initial values iter= 0, 
&og = 0, and fac= 128/2 ,,er = 128 set in operation 7.004. 

• If /fer<10 (operation 7.004), each iteration in the bisection algorithm 
comprises an increment = 0og + fee in operation 7.005, and the evaluation 
of the bit consumption estimate R(g) in operations 7.006 and 7.007 with the new 
value of Qog. If the estimate R(g) exceeds the bit budget Ft in operation 7.008, 
A,, is updated in operation 7.009. The iteration ends by incrementing the 
counter iter and halving the step size fee in operation 7.010. After ten iterations, 
a sufficient accuracy for ^ is obtained and the global gain can be solved g = 
2 9b « /10 in operation 7.01 1 . The noise level g„ s is estimated in operation 7.012 by 
averaging the bit consumption estimates of those splits that are likely to be left 
unquantized with the determined global gain g^g. 

Figure 8 shows the operations involved in determining the noise level fac. 
The noise level is computed as the square root of the average energy of the 
splits that are likely to be left unquantized. For a given global gain giog. a split is 
likeiy to be unquantized if its estimated bit consumption is less than 5 bits, i.e. if 
W - gios < 5. The total bit consumption of all such splits, R m (g),\s obtained by 
calculating R*(1) - flog over the splits for which f?*(1) - flog < 5. The average 
energy of these splits can then be computed in log domain from R M (g) as 
R M (g)/nb, where nb is the number of these splits. The noise level is 

in this equation, the constant -5 in the exponent is a tuning factor which adjusts 
the noise factor 3 dB (in energy) below the real estimation based on the average 
energy. 

* 

Multi-Rate Lattice Vector Quantization Module 5. 004 

Quantization module 6.004 is the multi-rate quantization means 
disclosed and explained in [Ragot, 2002]. The 8-dimensional splits of the 
normalized spectrum X' are coded using multi-rate quantization that employs a 
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set of RE 6 codebooks denoted as {Q 0 , Q 2 , Q3. ...)■ The codebook Oi is not 
' defined in the set in order to improve coding efficiency. The n lh codebook is 
denoted Q n where n is referred to as a codebook number. All codebooks Q„ are 
constructed as subsets of the same B-dimensional RE B lattice, Q„ c RE 6 , The bit 
5 rate of the n m codebook defined as bits per dimension is 4n/8, i.e. each 
codebook Q„ contains 2 4n codevectors. The multi-rate quantizer is constructed in 
accordance with the teaching of [Ragot, 2002]. 

For the A 1 " 8-dimensional split X**, the coding module 6.004 finds the 
nearest neighbor Y* in the RE a lattice, and outputs: 

10 o the smallest codebook number n k such that Y k e Q n k\ and 
6 the index k of Y* in Q n *. 

The codebook number n k is a side information that has to be made 
available to the decoder together with the index i k to reconstruct the codevector 
Y*. For example, the size of index i k is An k bits for n k > 1. This index can be 
1 5 represented with 4-bit blocks. 

For n k 0, the reconstruction becomes an 8-dimensional zero vector 
and i k is not needed. 

* 

Handling of Bit Budget Overflow and Indexing of Splits Module 6.005 

■ 

For a given global gain g, the real bit consumption may either exceed or 
20 - remain under the bit budget. A possible bit budget underflow is not addressed by 
any specific means, but the available extra bits are zeroed and left unused. 
' When a bit budget overflow occurs, the bit consumption is accommodated into 
the bit budget R x in module 6.005 by zeroing some of the codebook numbers no, 
n,, .... n K -i. Zeroing a codebook number n k > 0 reduces the total bit consumption 
25 at least by 5n r 1 . bits. The splits zeroed in the handling of the bit budget overflow 
are reconstructed at the decoder by noise fill-in. 

To minimize the coding distortion that occurs when the codebook 
numbers of some splits are forced to zero, these splits shall be selected 
prudently. In one embodiment, the bit consumption is accumulated by handling 
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the splits one by one in a descending order of energy e k = x„ T x* for k = 0, 1 

K- 1 . This procedure is signal dependent and in agreement with the means used 
earlier in determining the global gain. 

Before examining the details of overflow handling in module 6.005, the 
5 structure of the code used for representing the output of the multi-rate quantizers 
will be summarized. The unary code of n k > 0 comprises k- 1 ones followed by 
a zero stop bit. As was shown in Table 1 . 5n k - 1 bits are needed to code the 
index i k and the codebook number n k excluding the stop bit. The. codebook 
number n k = 0 comprises only a stop bit indicating zero split. When K splits are 
1 0 coded, only K- 1 stop bits are needed as the last one is implicitly determined by 
the bit budget R and thus redundant. More specifically, when k last splits are 
zero, only k - 1 stop bits suffice because the last zero splits can be decoded by 
knowing the bit budget ft 

Operation of the overflow bit budget handling module 6.005 of Figure 6 
15 is depicted in the flow chart of Figure 9. This module 6.005 operates with split 

indices «(0), *<1) determined in operation 9.001 by sorting the 

square-norms of splits in a descending order such that e m £ e K(n s ... * e^-n- 
Thus the index *(k) refers to the split x^ that has the k* largest square-norm. 
The square norms of splits are supplied to overflow handling as an output of 
20 operation 9.001 . 

The /c" 1 iteration of overflow handling can be readily skipped when n m =0 
by passing directly to the next iteration because zero splits cannot cause an 
overflow. This functionality is implemented with logic operation 9.005. if k<K 
(Operation 9.003) and assuming that the *fk) ,h split is a non-zero split, the RE 8 
25 point is first indexed in operation 9.004. The multi-rate indexing provides the 
exact value of the codebook number n m and codevector index /«*>. The bit 
consumption of all splits up to and including the current x{kf split can be 
calculated. 

Using the properties of the unary code, the bit consumption ft up to and 
30 including the current split is counted in operation block 9.008 as a sum of two 
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terms: the R D , * bits needed for the data excluding stop bits and the R St * stop 
bits: 

Rk = Ho./c'+fls.k ' ( 7 ) 

where for n^ > 0 

5 Ro. k = flo,*-i+ 5n» w -1> - ( 8 ) 

The required initial values are set to zero in operation 9.002. The stop bits are 
counted in operation 9.007 from Equation (9) taking into account that only splits 
up to the last non-zero split so far is indicated with stop bits, because- the 
1 0 subsequent splits are known to be zero by construction of the code. The index of 
the last non-zero split can also be expressed as max{/r(0), K{k) xtfc)}. 

Since the overflow handling starts from zero initial values for R D . k and 
f? s _ k in equations (8) and (9), the bit consumption up to the current split fits 
always into the bit budget, R s ,m + Ro. n < R- If the bit consumption Rk including 
15 the current K{kf split exceeds the bit budget R as verified in logic operation 

9.008, the codebook number n A<w and reconstruction y^ are zeroed in block 

9.009. The bit consumption counters R p , k and Ro, k are accordingly updatedreset 
to their previous values in block 9.010. After this, the overflow handling can 
proceed to the next iteration by incrementing k by 1 in operation 9.01 1 and 

20 returning to logic operation 9.003. 

* 

Note that operation 9.004 produces the indexing of splits as an integral 
part of the overflow handling routines. The indexing can be stored and supplied 
further to the bit stream multiplexer 6.007 of Figure 6. 

Quantized spectrum de-shaping module 5.007 

25 Once the. spectrum is quantized using the split multi-rate lattice VQ of 

module 5.006, the quantization indices (codebook numbers and lattice point 
indices) can be calculated and sent to a channel through a multiplexer (not 
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shown). A nearest neighbor search in the lattice, and index computation, are 
performed as in [Ragot, 2002). The TCX coder 4 then performs spectrum de- 
shaping in module 5.007, in such a way as to invert the pre-shaping of module 
5.005. 

5 Spectrum de-shaping operates using only the quantized spectrum. To 

obtain a process that inverts the operation of module 5.005, module 5.007 
applies the following steps : 

□ calculate the position / and energy E max of the 8-dimensional block 
of highest energy in the first quarter (low frequencies) of the 

10 spectrum; . 

□ calculate the energy E m of the 8-dimensional block at position 
index m ; 

□ compute the ratio- R m = Emax I E m \ 

□ if R m > 10, then set R m = 10 ; 

■: 

1 5 □ also, if R m > f?(m-i) then R m = R{^)\ 



compute the value {R m ) 



1/2 



After computing the ratio R m = E max / E m for all blocks with position index smaller 
that /, a multiplicative inverse of this ratio is then applied as a gain for each 
corresponding block. Differences with the pre-shaping of module 5.005 are: (a) 

20 in the de-shaping of module 5.007, the square-root (and not the power 1 /<) of the 
ratio R m is calculated, and (b) this ratio is taken as a divider (and not a multiplier) 
of the corresponding 8-dimensional block. If the effect of quantizing in module 
5.006 is neglected (perfect quantization), it can be shown that the output of 
module 5.007 is exactly equal to the input of module 5.005. The pre-shaping 

25 process is thus an jnvertible process. 

HF encoding 
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The operation of the HF coding module 1.003 of Figure 1 is illustrated in 
Figure 10a. As indicated in the foregoing description with reference to Figure 1, 
the HF signal is composed of the frequency components of the input signal 
higher than 6400 Hz. The bandwidth of this HF signal depends on the input 
5 signal sampling rate. To code the HF signal at a low rate, a bandwidth extension 
(BWE) scheme is employed in one embodiment. In BWE, energy information is 
sent to the decoder in the form of spectral envelope and frame energy, but the 
fine structure of the signal is extrapolated at the decoder, from the received 
(decoded) excitation signal from the LF signal which, according to one 
1 0 embodiment, is encoded in the switched ACELP/TCX coding module 1 .002. 

The down-sampled HF signal at the output of the pre-processor and 
• analysis filterbank 1.001 is called s HF {n) in Figure 10a. The spectrum of this 
signal can be seen as a folded version of the higher-frequency band prior to 
down-sampling. An LPC analysis as described hereinabove with reference to 

15 Figure 18 is performed in modules 10.020-10.022 on the signal s HF {n) to obtain a 
set of LPC coefficients which model the spectral envelope of this signal. 
Typically, fewer parameters are necessary than for the LF signal. In one 
embodiment, a filter of order 8 was used. The LPC coefficients A(z) are then 
transformed into the ISP domain in module 10.023, then converted from the ISP 

20 domain to the ISF domain in module 1 0.004, and quantized in module 1 0.003 for 
transmission through a multiplexer 10.029. The number of LPC analysis in an 
80-ms super-frame depends on the frame lengths in the super-frame. The 
quantized ISF coefficients are converted back to ISP coefficients in module 
10.004 and then interpolated (can we briefly describe the method of 

25 interpolation) in module 10.005 before being converted to quantized LPC 
coefficients A H f (z) by module 1 0.006. 

A set of LPC filter coefficients can be represented as a polynomial in the 
variable z. Also, A(z) is the LPC filter for the LF signal and A HF (z) the LPC filter 
for the HF signal. The quantized versions of these two filters are respectively 
30 A (z) and A hf (*)• From the LF signal s(n) of Figure 1 0, a residual signal is first 
obtained by filtering s(n) through the residual filter A{z) identified by the 
reference 10.014. Then, this residual signal is filtered through the quantized HF 
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synthesis filter VA H f{z) identified by the reference 10.015. Up to a gain factor, 
this produces a synthesized version of the HF signal, but in a spectrally folded 
version. The actual HF synthesis signal will be recovered after up-sampling has 
been applied. 

Since the excitation is recovered from the LF signal, the proper gain is 
computed for the HF signal. This is done by comparing the energy of the 
reference HF signal s HF {n) with the energy of the synthesized HF signal. The 
energy is computed once per 5-ms subframe, with energy match ensured at the 
6400 Hz sub-band boundary. Specifically, the synthesized HF signal and the 
reference HF signal are filtered through a perceptual filter (modules 10.01 1- 

10.012 and 10.024-10.025). In the embodiment of Figure 10, this perceptual 
filter is derived from Anil and is called "HF perceptual filter". The energy of 
these two filtered signals is computed every 5 ms in modules 10.013 and 
10.026, respectively, the ratio between the energies calculated by the modules 

10.013 and 10.126 is calculated by the divider 10.027 and expressed in dB in 
module 10.016. There are 4 such gains in a 20-ms frame (one for every 5-ms 
subframe). This 4-gain vector represents the gain that should be applied to the 
HF signal to properly match the HF signal energy. , 

* 

Instead of transmitting this gain directly, an estimated gain ratio is first 
computed by comparing the gains of the filters A (z) from the lower band and 
A hf (z) from the higher band. This gain ratio estimation is detailed in Figure 10b 
and will be explained in the following description. The gain ratio estimation is 
interpolated every 5-ms, expressed in dB and subtracted in module 10.010 from 
the measured gain ratio. The resulting gain differences or gain corrections, noted 
- t0 ( in Figure 10 , are quantized in module 10.009. The gain corrections 
can be quantized as 4-dimensional vectors, i.e. 4 values per 20-ms frame and 
then supplied to the multiplexer 10.029 for transmission. 

The gain estimation computed in module 10.007 from filters A (z) and 
Ahf (z) is explained in Figure 10b. These two filters are available at the decoder 
side. The first 64 samples of a decaying sinusoid at Nyquist frequency ^radians 
per sample is first computed by filtering a unit impulse S(n) through a one-pole 
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filter 10.017. The Nyquist frequency is used since the goal is to match the filter 
gains at around 6400 Hz, i.e. at the junction frequency between the LF and HF 
signals. Here, the 64-sample length, of this reference signal is the sub-frame 
length (5 ms). The decaying sinusoid h(n) is then filtered first through filter A (z) 
5 1 0.01 8 to obtain a low-frequency residual, then through filter 1/Ahf(z) 1 0.01 9 to 
obtain a synthesis signal from the HF synthesis filter. If the filters A (z) and 
AhfW have identical gains at the normalized frequency of n radians per 
sample, the energy of the output x(n) of filter 10.019 would be equivalent to the 
energy of the input h(n) of filter 10.018 (the decaying sinusoid). If the gains differ, 

10 then this gain difference is taken into account in the energy of the signal x(n) at 
the output of filter 10.019. The correction gain should actually increase as the 
energy of the signal x(n) decreases. Hence, the gain correction is computed in 
module 10.028 as the multiplicative inverse of the energy of signal x(n), in the 
logarithmic domain (i.e. in dB). To get a true energy ratio, the energy of the 

15 decaying sinusoid h(n), in dB, should be removed from the output of module 
10.028. However, since this energy offset is a constant, it will simply be taken 
into account in the gain correction' coder in module 10.009. Finally the gain from 
module 10.007 is interpolated and expressed in dB before being subtracted by 
the module 10.010. 

20 At the decoder, the gain of the HF signal can be recovered by adding 

the output of the HF coding device 1 .003, known at the decoder, to the decoded 
gain corrections coded in module 1 1 .009. 

DETAILED DESCRIPTION OF THE DECODER ' 

* 

The role of the decoder is to read the coded parameters from the 
25 bitstream and synthesize a reconstructed audio super-frame. A high-level block 
diagram of the decoder is shown in Figure 11. 

As indicated in the foregoing description, each 80-ms super-frame is 
coded into four (4)" successive binary packets of equal size. These four (4) 
packets form the input of the decoder. Since all packets may not be available 
30 due to channel erasures, the main demultiplexer 11.001 also receives as input 
four (4) bad frame indicators BFI = (Mb. bfh, bfh, bfi 3 ) which indicate which of 
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the four packets have been received. It is assumed here that bfk = 0 when the it 
packet is received, and bfk = 1 when the Jr* packet is lost. The size of the four 
(4) packets is specified to the demultiplexer 11.001 by the input bit_ratejlag 
indicative of the the bit rate used by the coder. 

5 Main demultiplexing 

The demultiplexer 11.001 simply does the reverse operation of the 
multiplexer of the coder. The bits related to the encoded parameters in packet k 
are extracted when packet k is available, i.e. when bfk = 0. 

As indicated in the foregoing description, the coded parameters are 
10 divided into three (3) categories: mode indicators, LF parameters and HF 
parameters. The mode indicators specify which encoding mode was used at the 
coder (AGELP, TCX20, TCX40 or TCX80). After the main demultiplexer 11.001 
has recovered these parameters, they are decoded by a mode extrapolation 
module 11.002, an ACELP/TCX decoder 11.003) and an HF decoder 11.004, 
1 5 respectively. This decoding results into 2 signals, a LF synthesis signal and a HF 
synthesis signal, which are combined to form the audio output ot the post- 
processing and synthesis filterbank 11.005. It is assumed that an input flag FS 
indicates to the decoder what is the output sampling rate. In one embodiment, 
the. allowed sampling rates are 16 kHz and above. 

■ 

20 The modules of Figure 1 1 will be described in the following description. 

LF signal ACELP/TCX decoder 1 1.003 

The decoding of the LF signal involves essentially ACELP/TCX 
decoding. This procedure is described in Figure 12. The ACELP/TCX 
demultiplexer 12.001 extracts the coded LF parameters based on the values of 
25 MODE. More specifically, the LF parameters are split into ISF parameters on the 
one hand and ACELP- or TCX-specific parameters on the other hand. 
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The decoding of the LF parameters is controlled by a main ACELP/TCX 
decoding control unit 12.002. In particular, this main ACELP/TCX decoding 
control unit 12.002 sends control signals to an ISF decoding module 12.003, an 
ISP interpolation module 12.005, as well as ACELP and TCX decoders 12.007 

5 and 12.008. The main ACELP/TCX decoding control unit 12.002 also handles 
the switching between the ACELP decoder 12.007 and the TCX decoder 12.008 
by setting proper inputs to these two decoders and activating the switch selector 
12 009 The main ACELP/TCX decoding control unit 12.002 further controls the 
output buffer 12.010 of the LF signar so that the ACELP or TCX decoded frames 

1 0 are written in the right time segments of the 80-ms output buffer. 

The main ACELP/TCX decoding control unit 12.002 generates control 
data which are internal to the LF decoder: BFIJSF, nb (the number of 
subframes for ISP interpolation), bfl_acelp, L TC x (TCX frame length), BFI.TCX, 
switchjlag, and frame_selector (to set a frame pointer on the output LF buffer 
1 5 1 2.01 0). The nature of these data is defined herein below: 

> BFIJSF can be expanded as the 2-D integer vector BFIJSF = ( Wastage 
bfhM stage) arid consists of bad frame indicators for ISF decoding. The 
value" Wastage is binary, and M, 8 ,.s« age = 0 when the ISF 1 s ' stage is 
available and b// 1st _ stt89 = 1 when it is lost. The value 0 < bd^.^ * 31 is 

20 a 5-bit flag providing a bad frame indicator for each of the 5 splits of the 

ISF 2 nd stage: bfiznoiage = bfi 1sL _ s m + 2 * bfi 2nd _ sp a + 4 * bfi 3nL . S fM + 8 * 
bfi 40 ^m + 16 * bfi 5th _s P u, where bfi klh _sp m = 0 when split k is available and 
is equal to 1 otherwise. With the above described bitstream format, the 
values of bfh s ^ and bfi^m can be computed from BFI = ( bfi 0 bfh 

25 bfh bfk ) as follows : 

For ACELP or TCX20 in packet k, BFIJSF = ( bfk ). 

For TCX40 in packets k and k+1, BFIJSF = ( bfk (31'bfk^) ), 

For TCX80 in packets k=0 to 3, BFIJSF = (bfi 0 
{bfh+6*bfk+20*bfk)) 
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These values of BFIJSF can be explained directly by the bitstream 
format used to pack the bits of ISF quantization, and how the stages and 
splits are distributed in one or several packets depending on the coder 
type (ACELP/TCX20, TCX40 or TCX80). 

5 > The number of subframes for ISF interpolation refers to the number of 5- 
ms subframes in the ACELP or TCX decoded frame. Thus, nb- 4 for 
ACELP and TCX20, 8 for TCX40 and 1 6 for TCX80. 

■ 

> bfLacelp is a binary flag indicating an ACELP packet loss. It is simply set 
as bfLacelp = bfk for an ACELP frame in packet k. 

10 > The TCX frame length (in samples) is given by L TC x = 256 (20 ms) for 

TCX20, 512 (40 ms) for TCX40 and 1024 (80 ms) for TCX80. This does 
not take into account the overlap used in TCX to reduce blocking effects. 

> BFIJTCX is a binary vector used to signal packet losses to the TCX 
decoder: BFLTCX = ( bfk ) for TCX20 in packet k, ( Uk bfk* ) for TCX40 

1 5 in packets k and k+1, and BFLTCX = BFI for TCX80. 

The other data generated by the main ACELP/TCX decoding control 
• unit 12.002 are quite self-explanatory. The switch selector 12.009 is controlled in 
accordance with the type of decoded frame (ACELP or TCX). The 
frame_selector data allows writing of the decoded frames (ACELP or TCX20, 
20 TCX40 or TCX80) into the right 20-rris segments of the super-frame. In Figure 
12 some auxiliary data also appear such as ACELP_ZIR and rm^. These 
data are defined in the subsequent paragraphs. 

ISF decoding module 12.003 corresponds to the ISF decoder defined in 
the AMR-WB speech coding standard, with the same MA prediction and 
25 quantization tables, except for the handling of bad frames. A difference 
compared to the AMR-WB device is the use of BFIJSF = ( Misuse b/fe n d_sia B e) 
instead of a single binary bad frame indicator. When the 1 st stage of the ISF 
quantizer is lost (i.e., W/, s ,. s «a B e = 1 ) the ISF parameters are simply decoded using 
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the 'irsm^r^Tr^oSxml'a the"AMR-WB"'iSF"dec6der; When "the 1 st 
stage is available (i.e. , W/ l8LstaBe = 0), this 1 sl stage is decoded. The 2 nd stage 
split vectors are accumulated to the decoded 1 s ' stage only if they are available. 
The reconstructed ISF residual is added to the MA prediction and the ISF mean 
vector to form the reconstructed ISF parameters. 

p 

Converter 12.004 transforms ISF parameters (defined in the frequency 
domain) into ISP parameters (in the cosine domain). This operation is taken from 
AMR-WB speech coding. 

* 

ISP interpolation module 12.005 realizes a simple linear interpolation 
between the ISP parameters of the previous decoded frame (ACELP/TCX20, 
TCX40 or TCX80) and the decoded ISP parameters. The interpolation is 
conducted in the ISP domain and results in ISP parameters for each 5-ms 
subframe, according to the formula: 

< 

iS Psubff ame-/ = ft* * 'SPnew + M Pb) * \sp M , 

where nb is the number of subframes in the current decoded frame (nb=A for 
ACELP and TCX20, 8 for TCX40, 16 for TCX80), /= 0,...,r*-1 is the subframe 
index, lsp 0l d is the set of ISP parameters obtained from the decoded ISF 
parameters of the previous decoded frame (ACELP, TCX20/40/80)' and isp n8W is 
the set of ISP parameters obtained from the ISF parameters decoded in decoder 
12.003. The interpolated ISP parameters are then converted into linear- 
predictive coefficients for each subframe in converter 1 2.006. 

The ACELP and TCX decoders 12.007 and 12.008 will be described 
separately at the end of the overall ACELP/TCX decoding description. 

« 

ACELP/TCX switching 

The description of Figure 12 in the form of a block diagram is completed 
by the flow chart of Figure 13, which defines exactly how the switching between 
ACELP and TCX is handled based on the super-frame mode indicators in 
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MODE; TT^re767TFigu7e T3"explains~ how "the 'modules - 1 2.003' to 1 2.006 of ' 
Figure 12 are used. 

One of the. key aspects of ACELP/TCX decoding is the handling of an 
overlap from the past decoded frame to enable seamless switching between 
5 ACELP and TCX as well as between TCX frames. Figure 13 presents this key 
feature in details for the decoding side. 

The overlap consists of a single 10-ms buffer: OVLP_TCX. When the 
past decoded frame is an ACELP frame, OVLP.TCX = ACELP.ZIR memorizes 
the zero-impulse response (ZIR) of the LP synthesis filter (1/A(z)) in the 
1 0 weighted domain of the previous ACELP frame. When the past decoded frame is 
a TCX frame, only the first 2.5 ms (32 samples) for TCX20, 5 ms (64 samples) 
for TCX40, and 10 ms (128 samples) for TCX80 are used in OVLP_TCX (the 
other samples are set to zero). 

As illustrated in Figure 13, the ACELP/TCX decoding relies on a 
15 sequential interpretation of the mode indicators in MODE. The packet number 
and decoded frame index k is incremented from 0 to 3. The loop realized by 
operations 13.002, 13.003 and 13.021 to 13.023 allows to sequentially process 
the four (4) packets of an 80-ms super-frame. The description of operations 
13.005, 13.006 and 13.009 to 13.011 is skipped because they realize the above 
20 described ISF decoding, ISF to ISP conversion, ISP interpolation and ISP to A($ 



conversion. 



When decoding ACELP (i.e. when n\=0 as detected in operation 
13 012), the buffer ACELP.ZIR is updated and the length ovpjen of the TCX 
overlap is set to 0 (operations 13.013 and 16.017). The actual calculation of 
25 ACELP.ZIR is explained in the next paragraph dealing with ACELP decoding. 

When decoding TCX, the buffer OVLP.TCX is updated (operations 
13 014 to 13 016) and the actual length ovpjen of the TCX overlap is set to a 
number of samples equivalent to 2.5, 5 and 10 ms for TCX20, TCX40 and 
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TCX80, respectively (operations 13.018 to 13.020). The actual calculation ot 
OVLPJTCX is explained in the next paragraph dealing with TCX decoding. 

* 

The ACELP/TCX decoder also computes two parameters for 
subsequent pitch post-filtering of the LF synthesis: the pitch gains g p = {go, 9u 

5 .... gis) and pitch lags T = (To. T, T 15 ) for each 5-ms subframe of the 80-ms 

7 super-frame. These parameters are initialized in Processor 13.001. For each 

new super-frame, the pitch gains are set by default to g pk = 0 for k=0 15, while 

the pitch lags are all initialized to 64 (i.e. 5 ms). These vectors are modif ied only 

by ACELP in operation 13.013: if ACELP is defined in packet k, g 4k , fltefi 

1 0 g 4k+3 correspond to the pitch gains in each decoded ACELP subframe, while T 4k , 
Tam T 4k+3 are the pitch lags. 

4 

ACELP decoding 

The ACELP decoder presented in Figure 14 is derived from the AMR-WB 
speech coding algorithm [Bessette et al, 2002]. The new or modified blocks 
1 5 compared to the ACELP decoder of AMR-WB are highlighted (by shading these 
blocks) in Figure 1 4. 

In a first step, the ACELP-specif ic parameter are demultiplexed through 
demultiplexer 14.001. 

Still referring to Figure 14, ACELP decoding consists of reconstructing 
20 the excitation signal r{n) as the linear combination g p p(n) + g e c(n), where g p and 
g c are respectively the pitch gain and the fixed-codebook gain, T the pitch lag, 
p(n) is the pitch contribution derived from the adaptive codebook 14.005 through 
the pitch filter 14.006, and c(n) is a post-processed codevector of the innovative 
codebook 14.009 obtained from the ACELP innovative-codebook indices 
25 decoded by the decoder 14.008 and processed through modules 14.012 and 
14.013; p(n) is multiplied by gain g p in multiplier 14.007, c(n) is multiplied by the 
gain g c in multiplier 14.014, and the products gp p{n) and g c c(n) are added in the 
adder module 14.015. When the pitch lag T is fractional, p(n) involves 
interpolation in the adaptive codebook 14.005. Then, the reconstructed 
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excitation is passed through the" synthesis filter 1/A(z) 14.016 to obtain the 
synthesis s(n). This processing is performed on a sub-frame basis on the 
interpolated LP coefficients and the synthesis is processed through an output 
buffer 14.017. The whole ACELP decoding process is controlled by a main 
ACELP decoding unit 14.002. Packet erasures (signalled by bfi_acelp = 1) are 
handled by a switch selector 14.011 switching from the innovative codebook 
14.00910 a random innovative codebook 14.010, extrapolating pitch and gain 
parameters from their past values in gain decoders 14.003 and 14.004, and 
relying on the extrapolated LP coefficients. 

The changes compared to the ACELP decoder of AMR-WB are 
concerned with the gain decoder 14.003, the computati6n of the zero-impulse 
■response (ZIR) of 1/ A(z) in weighted domain in modules 14.018 to 14.020, and 
the update of the r.m.s value of the weighted synthesis (rms W syn) in modules 
14.021 and 14.022. The gain decoding has been already disclosed when 
bfLacelp = 0 or 1 . It is based on a mean energy parameter so as to apply mean- 
removed VQ. 

The ZIR of 1/A(z) is computed here in weighted domain for switching 
from an ACELP frame to a TCX frame while avoiding blocking effects. The 
related processing is broken down into three (3) steps and its result is stored in a 
1 0-ms buffer denoted by ACELP_ZIR : 

1) a calculator computes the 10-ms ZIR of 1/A(z) where the LP 
coefficients are taken from the last ACELP subframe (module 
14.018); 

2) a filter perceptually weights the ZIR (module 14.019), 

3) ACELP_ZIR is found after applying an hybrid flat-triangular 
windowing (through a window generator) to the 10-ms weighted ZIR 
in module 14.020. This step uses a 10-ms window w{n) defined 
below: 
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W{ri) = 1 if /7=0,..,63, 

w(/7)=(128-n)/64 if n=64,..,127 

It should be noted that module 1 4.020 always updates OVLP.TCX as 
OVLPJTCX = ACELP_ZIR. 

5 The parameter rms^ is updated in the ACELP decoder because it is 

used in the TCX decoder for packet-erasure concealment. Its update in ACELP 
decoded frames consists of computing per subframe the weighted ACELP 
synthesis s w (n) with the perceptual weighting filter 14.021 and calculating in 
module 14.022: 



10 rms 



wsyu 



= Ji(s w (0) J + s w (l) 2 + ... + s w (L-l) 2 ) 



where L=256 (20 ms) is the ACELP frame length. 



TCX decoding 

One embodiment of TCX decoder is shown in Figure 15.. A switch 
selector 15.017 is used to handle two different decoding cases: 

. 1 5 Case 1 : Packet-erasure concealment in TCX20 through modules 15.013 

to 1 5.01 6 when the TCX frame length is 20 ms and the related packet is 

» 

lost, i.e. BFIJTCX = 1 ; and 

Case 2: Normal TCX decoding, possibly with partial packet losses 
through modules 15.001 to 15.012. 

. 20 In Case 1, no information is available to decode the TCX20 frame. The 

TCX synthesis is made by processing, through a non-linear filter roughly 
equivalent to 1/A(z) (modules 15.014 to 15.016), the past excitation from the 
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previousltecoded TCX frame stored in Tl^ excitatlon'buffer 15.01 3 arid delayed 
by T, where T=pitchjcx is a pitch lag estimated in the previously decoded TCX 
frame. A non-linear filter is used instead of filter 1/A(z) to avoid clicks in the 
synthesis. This filter is decomposed. in three (3) blocks: a filter 15.014 having a 
5 transfer function A(z/y)/ A(z)/(1-a z 1 ) to map the excitation delayed by T into 
the TCX target domain, limiter 15.015 to limit the magnitude to ± rms^yn, and 
finally filter 15.016 having a transfer function (1-a z' 1 )/ Mz/y) to find the 
synthesis. The buffer OVLP_TCX is set to zero in this case. 

: In Case 2, TCX decoding involves decoding the algebraic VQ parameters 
10 through the demultiplexer 15.001 and VQ parameter decoder 15. This decoding 
operation' is presented in another part of the present description. As indicated in 
the foregoing description, the set of transform coefficients Y = [ Y 0 Yi ... Wi ]. 
where N = 288, 576 and 1152 for TCX20, TCX40 and TCX80 respectively, is 
divided into K subvectors (blocks of consecutive transform coefficients) of 
15 dimension 8 which are represented in the lattice RE a . The number K of 
subvectors is 36, 72 and 1 44 for TCX20, TCX40 and TCX80. respectively. 
Therefore, the coefficients Yean be expanded as Y = [Y 0 Y%.... Yk-i ] with Y* = [ 

* 

Ye* ••• VW] and k= 0 , .. , K-1. 

• The noise fill-in level a noi se is decoded in noise-fill-in level decoder 1 5.003 
20 by inverting the 3-bit uniform scalar quantization used at the coder. For an index 
0 < idxy < 7, ohoi Se is given by : o-„ oise = 0.1 * (8 - idx,). However, it may happen 
that, the index /dx, is not available. This is the case when BFIJTCX = (1) in 
TCX20, (1 x) in TCX40 and (x 1 x x) in TCX80, with x representing an arbitrary 
binary value. In this case, ohoise is set to its maximal value, i.e. cr no ise = 0.8. 

■ 

4 

25 Comfort noise is injected in the subvectors Y* rounded to zero and which 

correspond to a frequency above 6400/6 = 1067 Hz (module 15.004). More 

precisely, Z is initialized as Z = Y and for K/6 <k SK (only), if K k = (0, 0 0), Z, 

is replaced by the 8-dimensional vector : 

Otoe * [ cos(Oi) sin(0 1 ) cos(9 2 ) sin(6 2 ) cos(9 3 ) sin(6 3 ) cos(6 4 ) sin(6 4 ) ], 
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where the phases 0i, 6 2l 0 3 and 9 4 are randomly selected. 

The adaptive low-frequency de-emphasis module 15.005 scales the 
transform coefficients of each sub-vector Z kl for k=O...KIAA. by a factor fac k 
(module 21.004 of Figure 21) which varies with k: 

X\ = fac*._Z k /f=0 K74-1. 

The factor fac k is actually a piecewise-constant monotone-increasing function of 
k and saturates at 1 for a given /c=/r ma x < K/4 (i.e. fac* < 1 for k < k max and fac* = 1 
for k > W max ). the value of k mak depends on Z. To obtain fac k , the energy e k of 
each sub-vector Z k is computed as follows (module 21 .001): 

e k = 2^ + 0.01 

where the term 0.01 is set arbitrarily to avoid a zero energy (the inverse of e k is 
later computed). Then, the maximal energy over the first K/4 subvectors is 
searched (module 21 .002): 

£max- max(£o, £«74-l) 

The actual computation of fac k is given by the formula below (module 21 .003): 

fac 0 = max( (fib/w) 05 . 0.1) 
;* f ac k = max( {e k /s max f s , f ac*.») f or k=1 , . . ., K/4- 1 

m 

The estimation of the dominant pitch is performed by estimator 1 5.006 so 
that the next frame to be decoded can be properly extrapolated if it corresponds 
to TCX20 and if the related packet is lost. This estimation is based on the 
assumption that the peak of maximal magnitude in spectrum of the TCX target 
corresponds to the dominant pitch. The search for the maximum M is restricted 
to a frequency below 400 Hz 

M = max i= i..mz ( X' 2 /) z + ( X ' 2/+ » f 



SUBSTITUTE SHEET (RULE 26) 



WO 2005/078706 PCT/CA2005/000220 

70 



and the minimal index 'l £, Ut * M32 such that ( X^,) 2 + ( ~X\ M ) 2 = M is also 
found. Then the dominant pitch is estimated in number of samples as 7 W , = N I 
W (this value may not be an integer). The dominant pitch is calculated for 
packet-erasure concealment in TCX20. To avoid buffering problems (the 
excitation buffer 15.013 being limited to 20 ms), if T est > 256 samples (20 ms), 
pitchjcx is set to 256 ; otherwise, if T e5t < 256, multiple pitch period in 20 ms 
are avoided by setting pitchjcx to 

pitchjcx = max { In T esl J | n integer > 0 and n T Mt $ 256} 

i 

where U denotes the rounding to the nearest integer towards -~. 

« 

The transform used is, in one embodiment, a DFT and is implemented as 
a FFT. Due to the ordering used at the TCX coder, the transform coefficients 
X'=(X' 0l . . .,X'n-i) are such that: 

o X' 0 corresponds to the DC coefficient; 

o X', corresponds to the Nyquist frequency (i.e. 6400 Hz since the time- 
domain target signal is sampled at 12.8 kHz); and 

o the coefficients X' 2fc and XW.i. for fe.1 ..N/2-1, are the real and imaginary 
parts of the Fourier component of frequency k(INI2) * 6400 Hz. 

FFT module 15.007 always forces X', to 0. After this zeroing, the time- 
domain TCX target signal x' w is found in FFT module 15.007 by inverse FFT. 

■ 

The (global) TCX gain Orcx is decoded in TCX global gain decoder 
15.008 by inverting the 7-bit logarithmic quantization used in the TCX coder. To 
do so, decoder 17.008 computes the r.m.s. value of fhe TCX target signal x' w as: 

rms = sqrt(1/A/(y„o 2 +^wi 2 +•••+ ^wl-i 2 )) 

* 

From an index 0 < idx 2 < 127, the TCX gain is given by: 
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T i /f frk 2 /28/(4xn») 

m 

The (logarithmic) quantization step is around 0.71 dB. 

This gain is used in multiplier 15.009 to scale x' w into x w . From the mode 
extrapolation and the gain repetition strategy as used in this illustrative 
5 embodiment, the index /dx 2 is available to multiplier 1 5.009. However, in case of 
partial packet losses (1 loss for TCX40 and up to 2 losses for TCX80) the least 
significant bit of idx z may be set by default to 0 in the demultiplexer 1 5.001 . 

■ 

♦ 

Since the TCX coder employs windowing with overlap and weighted ZIR 
removal prior to transform coding of the target signal, the reconstructed TCX 

10 target signal x = (*,, x, x*i) is actually found by overlap-add in synthesis 

module 15.010. The overlap-add depends on the type of the previous decoded 
frame (ACELP or TCX). A first window generator multiply the TCX target signal 

by an adaptive window w = [w 0 Wi ... Wam]: 

■ 

* 

* 

X| :=x ( * wi, i=0, .... L-1 

1 5 where w is defined by 

Wj = sin( rtovlpjen * (/+1 )fZ ), /' = 0 ovlpjen^ 

* 

W{ - 1, f'= ovlpjen, .... L-1 

« 

= cos( rf(L-N) * (/+1-L)/2 ), /= L, .... N-1 

If ovlpjen = 0, i.e. if the previous decoded frame is an ACELP frame, the 
20 left part of this window is skipped by suitable skipping means. Then, the overlap 
from the past decoded frame (OVLP.TCX) is added through a suitable adder to 
the windowed signal x : • 

[ Xo ... x 128 ] := [ Xo ... x 128 ] + OVLP.TCX 
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"fTwIpLlen = 0, OVLP_TCX is the 10-ms weighted ZIR of ACELP (128 
samples) of x. Otherwise, 

OVLPJTCX = [ x x ... x 0 0 ... 0 ],' 

olvpjen samples 



where ovlpjen may be equal to 32, 64 or 128 (2.5, 5 or 10 ms) which indicates 
that the previously decoded frame is TCX20, TCX40 or TCX80, respectively. 

The reconstructed TCX target signal is given by [ x 0 ... x L ] and the. last N- 
L samples are saved in the buffer OVLPJTCX : 



OVLP TCX := [x L ... 0 0 ... 0] 
~ » — y — / 

128-(L-N) samples 



The reconstructed TCX target is filtered in filter 15.011 by the inverse 
perceptual filter W 1 (z)=(1-a z')IA{zlY) to find, the synthesis. The excitation is 
also calculated in module 15.012 to update the- ACELP adaptive codebook and 
allow to switch from TCX to ACELP in a subsequent frame. Note that the length 
of the TCX synthesis is given by the TCX frameMength (without the overlap): 20, 
40 or 80 ms. 

Decoding of the higher-frequency (HF) signal 

■ 

■ 

The decoding of the HF signal implements a kind of bandwidth extension 
(BWE) mechanism and uses some data from the LF decoder. It is an evolution 
of the BWE mechanism used in the AMR-WB speech decoder. The structure of 
the HF decoder is illustrated under the form of a- block diagram in Figure 16. The 
HF synthesis chain consists of modules 16.012 to 16.014. More precisely, the 
HF signal is synthesized in 2 steps: calculation of the HF excitation signal, and 
computation of the HF signal from the HF excitation signal. The HF excitation is 
obtained by shaping in time-domain (multiplier 16.012) the LF excitation signal 
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"withTcalar factors" (or' gaihs)"'per 5-m's subframes. This HF excitation is post-" 
processed in module 16.013 to reduce the "buzziness" of the output, and then 
filtered by a HF linear-predictive synthesis filter 06.014 having a transfer function 
1Mhf(2). As indicated in the foregoing description, the LP order used to encode 
5 and then decode the HF signal is 8. The result is also post-processed to smooth 
energy variations in HF energy smoothing module 16.015. 

■. 

The HF decoder synthesizes a 80-ms HF super-frame. This super-frame 
is segmented according to MODE = (m 0 , m,, m 2 , nh). To be more specific, the 
decoded frames used in the HF decoder are synchronous with the frames used 
1 o in the LF decoder. Hence, m k <l,m k = 2andmK = 3 indicate respectively a 20- 
ms, 40-ms and 80-ms frames. These frames are referred to as HF-20, HF-40 
and HF-80, respectively. 

* 

From the synthesis chain described above, it appears that the only 
parameters needed for HF decoding are the ISF and gain parameters. The ISF 
15 parameters represent the filter 18.014 (iM H f(*)), while the .gain parameters are 
used to shape the LF excitation signal using multiplier 16.012. These parameters 
are demultiplexed from the bitstream in demultiplexer 16.001 based on MODE 
and knowing the format of the bitstream. 

The decoding of the HF parameters is controlled by '.a main HF decoding 
20 control unit 16.002. More particularly, the main HF decoding control unit 16.002 
controls the decoding (ISF decoder 16.003) and interpolation (ISP interpolation 
module 16.005) of linear-predictive (LP)' parameters. The main HF decoding 
control unit 16.002 sets proper bad frame indicators to the ISF and gain 
decoders 16.003 and 16.009. It also controls the output buffer 16.016 of the HF 
25 signal so that the decoded frames get written in the right time segments of the 
80-ms output buffer. 

* 

The main HF decoding control unit 16.002 generates control data which 
are internal to the HF decoder: bfijsf_hf, BFIJ3AIN, the number of subframes 
for ISF interpolation and a frame selector to set a frame pointer on the output 
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buffer 16.016. Except for the frame selector which is self-explanatory, .the nature 
of these data is defined in more details herein below: 

> bfiJsLhf is a binary flag indicating loss of the ISF parameters. Its 
definition is given below from BF1 = (bfio, bfh, bfk, bf'k): 

For HF-20 in packet k, bfijsfjhf* bfk , 

For HF-40 in packets /cand k+1, bfiJsLhf = bfk , 

■ » 

For HF-80 (in packets k=0 to 3), bfijsfjhf* bfi 0 

* 

This definition can be readily understood from the bitstream format. As 
indicated in the foregoing description, the ISF parameters for the HF 
signal are always in the first. packet describing HF-20, HF-40 or HF-80 
frames. 

> BFLGAIN is a binary vector used to signal packet losses to the HF gain 
decoder: BFLGAIN = ( bfk ) for HF-20 in packet k, ( bfk bfk* ) ; for HF-40 
in packets k and k+1 , BFLGAIN = BFl for HF-80. 

> The number of subf rames for ISF interpolation refers to the number of 5- 
ms subframe in the decoded frame. This number if 4 for HF-20, 8 for HF- 

♦ 

40 and 16 for HF-80. 

The ISF vector isf_hf_q is decoded using AR(1) predictive VQ in ISF 
decoder 16.003. If bfijsf_hf= 0, the 2-bit index /, of the 1 st stage and the 7-bit 
index k of the 2 nd stage are available and isf_hf_q is given by 

isf_hf_q = cb1 (/'i) + cb2(; 2 ) + mean_isf_hf + utof * mem_isf_hf 

where cblfa) is the A-th codevector of the 1 st stage, cb2(/ 2 ) is . the /a-th 
codevector of the 2 8 ' stage, mean_isf_nf is the mean ISF vector, i^lm = 0.5 is 

* 

the AR(1) prediction coefficient and mem_isf_hf is the memory of the ISF 
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predictive decoder. If bfijsf_hf= 1, the decoded ISF vector corresponds to the 
previous ISF vector shifted towards the mean ISF vector: 

* 

isf_hf_q = a isi_hf * memjsfjif + mean_isf_hf 

with a ls( _h( = 0.9. After calculating isf_hf_q, the ISF reordering defined in AMR- ' 
5 WB speech coding is applied to isf_hf_q with an ISF gap of 1 80 Hz. Finally the - 
memory mem_isf_hf is updated for the next HF frame as: 

mem_isf_hf = isf_hf_q - mean_isf_hf 

The initial value of memjsfjif (at the reset of the decoder) is zero. Converter 
16.004 converts the ISF parameters (in frequency domain) into ISP parameters 
10 (in cosine domain). 

ISP interpolation module 16.005 realizes a simple linear interpolation 
between the ISP parameters of the previous decoded HF frame (HF-20, HF-40 
or HF-80) and the new decoded ISP parameters. The interpolation is conducted 
in the ISF domain and results in ISF parameters for each 5-ms subframe, , 
15 according to the formula: 

* ■ 

ispsubftame-/ = Inb * ispnew + * is P<*». 

. * 

where nb is the number of subframes in the current decoded frame (nb=4 for 
HF-20, 8 for HF-40, 16 for HF-80). *=0,...,nM is the subframe index, isp ok) is the 
set of ISP parameters obtained from the ISF parameters of the previously . 
20 decoded HF frame and isp new is the set of ISP parameters obtained from the . 
ISF parameters decoded in Processors 18.003. The converter 10.006 then 
converts the interpolated ISP parameters into quantized linear-predictive 
coefficients A F z(z) for each subframe. 

Computation of the gain g maidh in dB in module 16.007 is described in the 
25 next paragraphs. This gain is interpolated in module 16.008 for each 5-ms 
subframe based on its previous value old_g maXC b as: 
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g. = ilnb * g m aich + [Vilnb)* o/cLg ma ich, 

where nb is the number of subframes in the current decoded frame (nb=4 for 
HF-20, 8 for HF-40, 16 for HF-80), /^.....nM is the subframe index. This 
results in a vector ( g Q , ... | ni _, ). 

5 Gain estimation computation to match magnitude at 6400 Hz (Module 

16.007) 

Processor 16.007 is described in Figure 10b. Since this process uses 
only the quantized version of the LPC filters, it is identical to what the coder has 
computed at the equivalent stage. A damped sinusoid of frequency 6400 Hz is 

10 generated by computing the first 64 samples [ n(0) n(1) ... h{63) ) of the 
impulse response h{n) of the 1 sl -order autoregressive filter 1/(1+0.9 z' 1 ) having a 
pole z = -0.9 (filter 10.017). This 5-ms signal h(n) is processed through the (zero- 
state) predictor A(z) of order 16 whose coefficients are taken from the LF 
decoder (filter 10.018), and then the result is processed through the (zero-state) 

15 synthesis filter l/A HF (z) of order 8 whose coefficients are taken from the HF 
decoder (filter 10.018) to obtain the signal x(n). The 2 sets of LP coefficients 
correspond to the last subframe of the current decoded HF-20, HF-40 or HF-80 
frame. A correction gain is then computed in dB as p ma ich = 10 log 10 [ 1/(*(0) + 
x(1) 2 + ... + x(63) z )) as illustrated in module 10.028. 

20 Recall that the sampling frequency of both the LF and HF signals is 

12800 Hz. Furthermore, the LF signal corresponds to the low-passed -audio 
signal, while the HF signal is spectrally a folded version of the high-passed audio 
signal. If the HF signal is a sinusoid at 6400 Hz, it becomes after the synthesis 
filterbank a sinusoid at 6400 Hz and not 12800 Hz. As a consequence it appears 

25 that g matC h is designed so that the magnitude of the folded frequency response of 
1O A (0 ma tcb/2O) />\ HF (z) matches the magnitude of the frequency response of 
1/A(z) around 6400 Hz. 

■ 

Decoding of correction gains and gain computation (Gain decoder 
16.009) 
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As described in the foregoing description, after gain interpolation, (the HF 

decoder gets from module 16.008 the estimated gains (gTo. flT'i $ Vi) ' n 

dB for each of the nb subf rames of the current decoded frame. Furthermore, nb 
= 4 8 and 1 6 in HF-20, HF-40 and HF-80, respectively. The role of the gain 
decoder 16.009 is to decode correction gains in dB which will be added, through 
adder 16.010, to the estimated gains- per subframe to form the decode gams 



So 1 S\ ■ '•*' © nb-\ 



(lofde;,!, fc/s;, .... 1^., W-(fo.«i I^-i) + 



where 



(f..f, I+J-tfyrf ^O + or-flTi ^,).. 

Therefore, the gain decoding corresponds to the decoding of predictive 
two-stage VQ-scalar quantization, where the prediction is given by the 
interpolated 6400 Hz junction matching gain. The quantization dimension is 
variable and is equal to nb. 

Decoding of the 1 st stage : 

The 7-bit index 0 < idx < 127 of the 1 s ' stage 4-dimensional HF gain 
codebook is decoded into 4 gains (G 0 , G„ G 2 , G 3 ). A bad frame indicator bfi = 
BFLGAINo in HF-20, HF-40 and HF-80 allows to handle packet losses. If bfi - 
0, these gains are decoded as 

(Go, G,, G 2 , G 3 ) = cb_galn_hf(idx) + mean_gain_hf 

where cb_gain_hf(/dx) is the ftfc-th codevector of the codebook cb_gain_hf. If 
bfi =1 , a memory pasLgain_hf_q is shifted towards -20 dB : 

i 

past_gain_hf_q :- Ogain.w * (j>ast_gain_hf_q + 20; - 20. 
where a*u* = 0.9 and the 4 gains (G 0 . G„ G 2 , G 3 ) are set to the same value: 



SUBSTITUTE SHEET (RULE 26) 



WO 2005/078706 PCT/CA2005/000220 

78 

Gk = past_gain_hLq + mean_gain_hf t for /c= 0,1 1 2 and 3 
Then the memory past_gain_hf_q is updated as: 

past_gain_htq '■= (Go + G t + G 2 + G 3 )/4 - mean_gain_hf. 
The computation of the 1 81 stage reconstruction is then given as: 
5 HF-20: (flf'o, <f 'i, fz , flf's) = (Go, Gi. G 2 , Gg). 

HF-40: (flr" 0 . 9°\ tf'r) = (Go, Go, G,, G,, G 2 , G 2 , G 3 , G 3 ). 

HF-80: (flf'o, fif'i /'is) = (Go. Q». G 0> Go. G,, G,, G,, G,, G 2l 

G 2 , G 2 , G 2 , G 3 , G3, G3, G3). 

■ ■ 

Decoding of ^ d stage : 

* 

1 0 In TCX-20, <tf* 0 . A <f 3 ) is simply set to (0,0,0,0) and there is no real 2 nd 
stage decoding. In HF-40, the 2-bit index 0 < Wx, < 3 of the /-th subframe, where 
i=0, ...,7, is decoded as: 

« 

If W7 = 0, gf 2 i = 3 * idx\ - 4.5 else g*\ = 0. 

In TCX-80, 16 subframes 3-bit index the 0 < Wx, £ 7 of the /-th subframe, where 
15 /=0 15, is decoded as: 

If bff=0,g c2 t = 3*idx-10.5 else 5^ = 0. 

In TCX-40 the magnitude of the second scalar refinement is. up to ± 4.5 
dB and in TCX-80 up to ± 1 0.5 dB. In both cases, the quantization step is 3 dB. 

HF gain reconstruction : 
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The gain for each subframe is then computed in module 16.011 
asilO*'' 20 

Buzziness reduction module 16.013 and HF energy smoothing module 
16.015) 

5 The role of buzziness reduction module 16.013 is to attenuate pulses in 

the time-domain HF excitation signal which often cause the audio output 
to sound "buzzy". Pulses are detected by checking if the absolute value | r HF (n) | 
> 2 * thres{n), where thres{n) is an adaptive threshold corresponding to the time- 
domain envelope of r HF (n). The samples r HF (r>) which are detected as pulses are 

1 0 limited to ± 2 * thres(h), where ± is the sign of r HF {n). 

Each sample r HF (n) of the HF excitation is filtered by a 1 st order low-pass 
filter 0.02/(1 - 0.98 z 1 ) to update fnres(n). The initial value of thres{n) (at the 
reset of the decoder) is 0. The amplitude of the pulse attenuation is given by : 

A = max( \r HF {n)\-2*thres{n) , 0.0). 

1 5 Thus, A is set .to 0 if the current sample is not detected as a pulse, which will let 
r HF (n) unchanged. Then, the current value thres(n) of the adaptive threshold is 
changed as : 

thres(n) := thres(n) + 0.5 * A. 

Finally each sample r*(n) is modified to : rW(n) = r HF (n) -A if r HF (n) > 0, and 
20 rHF(n) = rnf(n) +A otherwise. 

The short-term energy variations of the HF synthesis s HF (n) are smoothed 
in module 16.015. The energy is measured by subframe. The energy of each 
subf rame is modified by up to ± 1 .5 dB based on an adaptive threshold. 

For a given subframe [s HF (0) s HF (?) ... s HF (63)], the subframe energy is 
25 calculated as 
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e 2 = 0.0001 + Shf(0) 2 + s HF (t) 2 + - + 5 hf(&?) 2 . 



The value f of the threshold is updated as: 



f = min(e 2 *1. 414,0. ife <f 

max( e 2 / 1.414, t), otherwise. 
The current subframe is then scaled by >/(t / e 2 ) : 

9 

(s'hf(O) s' hf (1) ... s'hf(63)] = V(t / e 2 ) * [Shf(O) s H f[1) - s HF (63)] 
Post-processing & synthesis filterbank 

» 

The post-processing of the LF and HF synthesis and the recombination of 
the two bands into the original audio bandwidth are illustrated in Figure 17. 

The LF synthesis (which is the output of the ACELP/TCX decoder) is first 
pre-emphasized by the filter 17.001 of transform function 1/(1-ccp reemp h z" 1 ) where 
apreemph = 0.75. The result is passed through a LF pitch post-filter 17.002 to 
reduce the level of coding noise between pitch harmonics only in ACE LP 
decoded segments. This post-filter takes as parameters the pitch gains g P = (a*. 

g p1 ftl8 ) and pitch lags T = (T 0 , T, T 15 ) for each 5-ms subframe of the 

80-ms super-frame. These vectors, g P and T are taken from the ACELP/TCX 
decoder. Filter 17.003 is the a^-order 50 Hz high-pass filter used in.AMR-WB 
speech coding. 

The post-processing Of the HF synthesis is made through a delay module 
17.005, which realizes a simple time alignment of the HF synthesis to make it 
synchronous with the post-processed LF synthesis. The HF synthesis is thus 
delayed by 76 samples so as to compensate for the delay generated by LF pitch 
post-filter 17.002. 
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The synthesis filterbank is realized by LP upsampling module 17.004, HF 
upsampling module 17.007 and the adder 17.008. The output sampling* rate FS 
= 16000 or 24000 Hz is specified as a parameter. The upsampling from 12800 
Hz to FS in modules 17.004 and 17,007 is implemented in a similar way as in 
5 AMR-WB speech coding. When FS = 16000, the LF and HF post-filtered signals 
are upsampled by 5, processed by a 120-th order FIR filter, then downsampled 

_ by 4 and scaled by 5/4. The difference between upsampling modules 17.004 
and 17.007 is concerned with the coefficients of the 120-th order FIR filter. 
Similarly, when FS = 24000, the LF and HF post-filtered signals are upsampled 

10 by 15, processed by a 368-th order FIR filter, then downsampled by 8 and 
scaled by 15/8. Adder 17.008 finally combines the two upsampled LF and HF 
signals to form the 80-ms super-frame of the output audio signal. 

* • * 

Although the present invention has been described hereinabove by way 
of non-restrictive illustrative embodiment, it should be kept in mind that these 
15 embodiments can be modified at will, within the scope of the appended claims 
without departing from the scope, nature and spirit of the present invention. 
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Table A-1 

List of the key symbols in accordance with 
the illustrative embodiment of the invention 



(a) self-scalable multirate RE& vector quantization. 



Symb 


■« . " • • • i 
Meaningi/.: j v. : 


4 

Note 

* 


N 


dimension of vector 
quantization 

* 


* — ! 

* 


A 


(regular) lattice in dimension N 


■ 


ring 


r^n<?^pt lattirp in dimension 8. 


* 


xor* 


Source vector in dimension 8. 




y or y 






n 


Codebook number, restricted to 
the set {0, 2, 3, 4, 5,...}. 


• 


On 


Lattice codebook in /lof 

index a 

* 


In the self-scalable multirate 
RE 8 vector quantizer, Q„ is 
indexed with 4n bits. 


• 


Index of the lattice pointy in a 
codebook Q„. 


In the self-scalable multirate 
RE Q vector quantizer, the index 
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(b) split self-scalable multirate flE 8 vector quantization. 



Symb 

■ . ■ 

n 



A/ 



Meanings - 

rounding to the nearest integer 
towards +°° 



K number of 8-dimensional 



flE 8 K 



dimension of 
quantization 



Note 



sometimes called ceilQ 



vector multiple of 8 



subvectors 



REb Gosset lattice in dimension 8. 



cartesian product of RE 8 (K 
times): 

RE 8 K = HE Q ® ... ® AE 8 

/V-dimensional source vector 

/V-dimensional input .vector for 
split REq vector quantization 



gain parameter of gain-shape 
vector quantization . 

vector of split energies (K-tuple) 



this is a N-dimensional lattice 



x=1/gz 



e=(e(0) , ... ,e(K-D) 



e(k) = z(8kf+ .... + 



SUBSTITUTE SHEET (RULE 26) 



WO 2005/078706 PCT/CA2005/000220 

83 







/ is represented with 4n bits. 




Binary representation of the 


bee l aoie £ Tor an exanitjie. 




codebook number n 




R 


bit allocation to self-scalable 






multirate RE& vector 






quantization (i.e. available bit 

• 






budget to quantize x) 
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offset 



fac 



ng 



On 



la 





z(8k+7f,0<k<K-1 


vector of estimated split bit . 


R=(R(0), ... ,R(K-1)) 


budget (K-tuple) for g=1 




\tc%n\nr nf p<;timatGd SDlit bit 


1 » * ** 

• 


allocations (K-tuple) for a given 




offset 


{ r\r o ni\/on OrrCP/ 

TOT a yiVcll uuoui f 




b(7<; =fl(ty - offsef.if 


* i 


oft) <0, d(7c; :=0 


integer offset in logarithmic 




domain used in the discrete 

• i 




search for the optimal g 


0< offset 255 


noise level estimate 

* 




Hn<5pqt lattice ooint to x in RE& 

• 


* 1 


vector ot cuucuuurv ii«ii |u ° |g 

• ■ 


na=(nq(0) , ... ,nq(K-1)i) 


^/Vlupltf/ 


each entry noft) is restricted to 


• 

• 


* 

• 


the set {0, 2, 3, 4, 5, ...). 


* 

Lattice codebook in 


Q n is indexed with 4n bits. 

i 


REq of index a 


* '1 


vector of indices (K-tuple) 

■ 


i£=(iq(0) iq(K-1)) 




the index iq(k) is represented 


■ 


with 4nq(k) bits. 
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ng g | vector of (variable-length) | See Table 2 for an example, 
binary representations for the 
codebook numbers in nc£ 

R I bit allocation to split self- 
scalable multirate HE 8 vector 
quantization (i.e. available bit 
budget to quantize x) 

nq' - I vector of codebook numbers] n£=(nq'(0), ... ,nq'(K-1)) 
(/(-tuple) such that the bit 

budget necessary to multiplex I each entry nq'(k) 0 is restricted 
of ng^and /g (until subvecotr|to the set (0, 2, 3, 4, 5, ...}. 
last) does not exceed R 

last index of the -last subvector to be 0 < last < K-1 
multiplexed in formatting table 
parm > 



QQs 



indices of • subvectors ■ sorted \ggs=(ps(0) t ... ,pos(K-1)i) 
with respect to their split 

energies | fios is a permutation 

(0.i,..,K-1) 



of 



e(pos(0)) > e(pos((1)) z :.. >\ 
e(pos(K-1)) 



parm | integer formatting 
multiplexing 



table for [R/4] integer entries 



each entry has 4 bits, except for 
the last one which has (R mod 1 
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4) bits if R is not a multiple of 4, 




• 


otherwise 4 bits. 


post 


* 

pointer to write/read indices in 

* 


in the single-packet case: 

• * 




formatting table parm 






* 


initialized to 0, incremented by 






integer steps multiple of 4 


POSn 


pointer to write/read codebook 


in the single-packet case: . 




numbers in formatting table 






parm 


initialized to R-1, decremented 






by integer steps 



.- 



* 
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(c) transform coding based on split self-scalable multirate RE* vector 

quantizations 



Symb 



■S V v 



ol 



N 



RE 6 



R 



Meaning . 

.. .■ \ • 



dimension 
quantization 



of 



vector 



Gosset lattice in dimension 8. 

bit allocation to self-scalable 
multirate RE B vector 
quantization (i.e. available bit 
budget to quantize x) 



Note 



* ■ 
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Table 4. Bit allocation for a 20-ms ACELP frame. 
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Table 5a. Bit allocation for a 20-ms TCX frame. 
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ISF Parameters 



Gain 
Gain Corrections 



0/8x2/ 16x3 




Table 6. Bit allocation for bandwidth extension. 
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